Content retrieval systems for distribution items

ABSTRACT

Systems, methods and apparatus are disclosed for providing content associated with an information item on a distribution item using a computing device. In one aspect a method includes identifying an image of an information item on a distribution item. The method further includes processing, in a processor the image, to generate a data item determined by the information item. The method further includes decoding the data item to determine a set of attributes of the distribution item. The method further includes retrieving content associated with the distribution item using at least one of the attributes in the set of attributes. The method further includes delivering content associated with the distribution item.

CROSS REFERENCES TO RELATED APPLICATIONS

This application claims benefit under 35 U.S.C. §119(e) to U.S.Provisional Patent Application No. 61/510,456 entitled “INTELLIGENTBARCODE CONTENT RETRIEVAL SYSTEMS” filed on Jul. 21, 2011, thedisclosure of which is hereby incorporated by reference in its entirety.This application further claims benefit under 35 U.S.C. §119(e) to U.S.Provisional Patent Application No. 61/512,343 entitled “CONTENTRETRIEVAL SYSTEMS FOR DISTRIBUTION ITEMS” filed on Jul. 27, 2011, thedisclosure of which is also hereby incorporated by reference in itsentirety.

BACKGROUND

1. Field

This development relates to using information affixed to a distributionitem and methods and systems of processing distribution items usinginformation affixed to a distribution item to link recipients withadditional content and/or services associated with the distributionitem.

2. Background

Mailers that use the mail delivery systems typically affix data such asbarcodes to their distribution items such as mail pieces to help themailing system sort, track, and deliver the distribution items.Conventionally, mailing systems offer automation discounts for mailersthat place such information on their mail pieces. In addition tooffering automation discounts, mailing systems can provide additionalservices to meet the business needs of mailers. Mailers, and inparticular business mailers, typically want to know where their mail isin the mail stream, how it is being processed by the mailing system,when their mail pieces are delivered, and how complete and accuratetheir addresses are. Mailers also seek access to more data about theirmail pieces as they travel through the mail stream. Mailing servicesseek such data to monitor processing, improve services, reduce costs,and accurately calculate postal charges. Further, mailing services seekto expand the scope and type of services that may be provided throughthe delivery and receipt of distribution items.

For example, when a distribution item is sent, the mailer may wish toencourage or provide additional information or offerings beyond what iscost effective or possible to provide with the distribution item itself.While a distribution item may include information that providesinstructions or requests for how a recipient may be provided withfurther information or services, in many scenarios, the recipient may beunwilling to take further action due to inconvenience or difficulty. Assuch, the services and offerings provided by a mailer to a recipient maybe limited to the contents of the distribution item itself. Obtainingthe participation of a recipient in additional interactive offerings maybe difficult.

SUMMARY

Various embodiments of systems, methods and devices within the scope ofthe appended claims each have several aspects, no single one of which issolely responsible for the desirable attributes described herein.Without limiting the scope of the appended claims, some prominentfeatures are described herein.

Details of one or more embodiments of the subject matter described inthis specification are set forth in the accompanying drawings and thedescription below. Other features, aspects, and advantages will becomeapparent from the description, the drawings, and the claims.

An embodiment provides a computerized method. The computerized methodincludes identifying an image of an information item on a distributionitem. The computerized method further includes processing, in aprocessor the image, to generate a data item determined by theinformation item. The computerized method further includes decoding thedata item to determine a set of attributes of the distribution item. Thecomputerized method further includes retrieving content associated withthe distribution item using at least one of the attributes in the set ofattributes. The computerized method further includes delivering contentassociated with the distribution item.

One embodiment provides a computing device. The computing deviceincludes an image capture device. The computing device includes aprocessor. In some aspects, the processor can receive image data fromthe image capture device. In some aspects, the processor can identify animage of an information item on a distribution item using the image dataand generate a data item determined by the information item. Thecomputing device includes a decoder component. In some aspects, thedecoder component can decode the data item to determine a set ofattributes of the distribution item. The computing device includes anetwork component. In some aspects, the network component can transmitat least one of the attributes in the set of attributes and receive aresponse indicating content associated with the distribution item. Thecomputing device includes a display device configured to display theimage of the information item and to display the content associated withthe distribution item.

One embodiment provides a computing device. The computing deviceincludes an image capture device. The computing device includes aprocessor. In some aspects, the processor can receive image data fromthe image capture device. In some aspects, the processor can identify animage of an information item on a distribution item using the image dataand generate a data item determined by the information item. Thecomputing device includes a network component. In some aspects, thenetwork component can transmit the data item to a decoder service andreceive a response from the decoder service indicating contentassociated with the distribution item: The computing device includes adisplay device. In some aspects, the display device can display theimage of the information item and display the content associated withthe distribution item.

An embodiment provides a system. The system includes a computing device.The computing device includes an image capture device and a processor.In some aspects, the processor can receive image data from the imagecapture device. In some aspects, the processor can identify an image ofan information item on a distribution item using the image data andgenerate a data item determined by the information item. The computingdevice includes a network component that can transmit the data item. Thecomputing device includes a display device. The system includes aserver, remote from the computing device that can receive the data item.The server includes a decoding component. In some aspects, the decodingcomponent can decode the data item to determine a set of attributes ofthe distribution item. The server includes a processing component. Insome aspects, the processing component can retrieve content associatedwith the distribution item using at least one attribute in the set ofattributes of the distribution item. In some aspects, the server cansend a message to the computing device indicating content associatedwith the distribution item. In some aspects, the display device candisplay the image of the decoded value and display the contentassociated with the distribution item in response to the message fromthe server.

An embodiment provides a computerized method. The computerized methodincludes retrieving an image of an information item from a distributionitem using a computing device. The computerized method includesprocessing in a processor the image so as to decode the information itemto determine a set of attributes of the distribution item. Thecomputerized method includes retrieving content associated with thedistribution item using at least one of the attributes in the set ofattributes. The computerized method includes enabling the computingdevice to display the content associated with the distribution item.

An embodiment provides a computerized method. A computerized methodincludes receiving a message including data associated with aninformation item affixed to a distribution item. A computerized methodincludes determining in a processor a set of attributes of thedistribution item based on the data associated with the information itemaffixed to the distribution item. A computerized method includesdetermining content associated with the distribution item using at leastone of the attributes in the set of attributes. A computerized methodincludes sending the content to a computing device.

An embodiment provides a system. The system includes a database. In someaspects, the database can store information associating an attribute ofa distribution item with a content item. The system includes aprocessor. In some aspects, the processor can receive informationassociated with an information item affixed to a distribution item overa network. In some aspects, the processor can determine a set ofattributes of the distribution item based on the information associatedwith the information item. In some aspects the processor can query thedatabase to retrieve a content item associated with at least one of theattributes in the set of attributes. In some aspects the processor cansend the content item to a computing device.

An embodiment provides a computing device for processing a distributionitem. The device includes means for identifying an image of aninformation item on the distribution item. The device further includesmeans for processing to generate a data item determined by theinformation item. The device further includes means for decoding thedata item to determine a set of attributes of the distribution item. Thedevice further includes means for retrieving content associated with thedistribution item using at least one of the attributes in the set ofattributes. The device further includes means delivering contentassociated with the distribution item.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a top level block diagram illustrating one embodiment of amailing system using various types of information affixed to a physicaldistribution item for mailing.

FIG. 2 shows an example of a system for providing content associatedwith a distribution item to the recipient of a distribution item byusing an information item affixed to or printed on the distributionitem.

FIG. 3 shows a flowchart of an exemplary method for providing contentassociated with a distribution item to a recipient using a computingdevice operated by the recipient as shown in FIG. 2.

FIG. 4A shows a flowchart of an exemplary method for determining contentassociated with a distribution item using data derived from aninformation item affixed to the distribution item.

FIG. 4B shows another flowchart of an exemplary method for determiningcontent associated with a distribution item using data derived from aninformation item affixed to the distribution item.

FIG. 5 shows a flowchart of an exemplary method for retrievinginformation associated with a distribution item including an informationitem.

FIG. 6 shows a flowchart of an exemplary method for determining contentassociated with a distribution item using an data derived from an imageof an information item.

FIG. 7 shows a flowchart according to an exemplary system where imageprocessing is performed by the computing device used to capture an imageof the information item.

FIG. 8 shows a flowchart according to an exemplary system where imageprocessing of image of an information item affixed to a distributionitem is performed by a web service on a server.

FIG. 9 illustrates an intelligent barcode that can be used in systemsaccording to embodiments of the development.

FIG. 10 illustrates an example of other types of barcodes that may beused according to embodiments of the development.

FIGS. 11A and 11B illustrate the barcodes of FIG. 10 in greater detail.

FIG. 12 illustrates an intelligent barcode according to embodiments ofthe development.

FIG. 13 shows a flowchart of an exemplary method for delivering contentassociated with a distribution item with an affixed intelligent barcodeto a computing device as shown in FIG. 2.

FIG. 14A shows the four types of bars included in an intelligentbarcode.

FIG. 14B shows an example of an intelligent barcode image along withencoded values determined by the intelligent barcode image.

FIG. 15 shows a flowchart of an exemplary method for retrievinginformation associated with a distribution item including an intelligentbarcode.

FIG. 16 shows a flowchart of an exemplary method for interpreting anintelligent barcode image to determine the corresponding ADFT charactersequence.

FIG. 17 shows an flowchart of an exemplary method for determiningcontent associated with a distribution item using an ADFT charactersequence derived from an image of an intelligent barcode.

FIG. 18 shows a flowchart according to an exemplary system where imageprocessing is performed by the computing device used to capture theintelligent barcode image.

FIG. 19 shows a flowchart according to an exemplary system where imageprocessing of an image of an intelligent mail barcode is performed by adecoder web service on a server.

FIGS. 20A, 20B, and 20C show an example of a user interfaces that may beused with the systems described in FIGS. 1-19.

FIGS. 21A, 21B, and 21C show examples of one embodiment of aninformation item such as an image used in connection with a distributionitem.

FIGS. 22A and 22B show examples of other embodiments of an informationitem with images used in connection with a distribution item.

FIG. 23 shows a flowchart depicting one method of requesting andreceiving additional information associated with a distribution item.

FIG. 24 shows a flowchart depicting one method of obtaining a codesequence from an information item.

FIGS. 25A, 25B, and 25C show examples of one embodiment of the displayof a computing device used to acquire additional information associatedwith a distribution item.

FIG. 26 shows an example of one aspect of a method for facilitating thepurchase and delivery of a product or products.

FIG. 27 shows a flowchart of an exemplary method for facilitating thepurchase and delivery of a product as shown in FIG. 26.

FIG. 28 shows an exemplary functional block diagram illustrating oneembodiment of a computer system that can be used in retrieving contentassociated with a mail piece using an encoded value.

Various features illustrated in the drawings may not be drawn to scale.Accordingly, the dimensions of the various features may be arbitrarilyexpanded or reduced for clarity. In addition, some of the drawings maynot depict all of the components of a given system, method or device.Finally, like reference numerals may be used to denote like featuresthroughout the specification and figures.

DETAILED DESCRIPTION

Various aspects of embodiments within the scope of the appended claimsare described below. It should be apparent that the aspects describedherein may be implemented in a wide variety of forms and that anyspecific structure and/or function described herein is merelyillustrative. Based on the present disclosure a person/one havingordinary skill in the art should appreciate that an aspect describedherein may be implemented independently of any other aspects and thattwo or more of these aspects may be combined in various ways. Forexample, an apparatus may be implemented and/or a method may bepracticed using any number of the aspects set forth herein. In addition,such an apparatus may be implemented and/or such a method may bepracticed using other structure and/or functionality in addition to orother than one or more of the aspects set forth herein.

The word “exemplary” is used herein to mean “serving as an example,instance, or illustration.” Any embodiment described herein as“exemplary” is not necessarily to be construed as preferred oradvantageous over other embodiments. The following description ispresented to enable any person skilled in the art to make and use theinvention. Details are set forth in the following description forpurpose of explanation. It should be appreciated that one of ordinaryskill in the art would realize that the invention may be practicedwithout the use of these specific details. In other instances, wellknown structures and processes are not elaborated in order not toobscure the description of the invention with unnecessary details. Thus,the present invention is not intended to be limited by the embodimentsshown, but is to be accorded with the widest scope consistent with theprinciples and features disclosed herein.

Embodiments of the developments described herein can include suchfeatures as, but not limited to, the use of data that may be extractedfrom a physical distribution item for associating content withdistribution items using a computing device. Individually or incombination, systems according to embodiments of the development canallow computing devices to access content associated with distributionitems using data that may be extracted from a physical distributionitem.

Persons of skill in the art will understand that mailing systems are butone embodiment of the development, and described herein for purposes ofdisclosure. Mailing systems, methods, and processes as described hereincan be broadly interpreted to include, for example, shipping systems;warehouse receipt, storage, and delivery systems; and baggage handlingsystems. Similarly, distribution items as described herein can bebroadly interpreted to include, for example, mail pieces, letters,postcards, parcels, bags in a baggage handling system, packages in ashipping system, shipping containers in a long distance transportsystem, and objects in a warehousing system.

FIG. 1 is a top level block diagram illustrating one embodiment of amailing system 100 using various types of information affixed to aphysical distribution item for mailing. The information affixed to adistribution item may include barcodes (e.g., 1D, 2D, and 3D barcodes),postage, permits, mailing system provider markings, address information,images, short-range wireless objects (e.g., radio-frequencyidentification (RFID) tags), and the like. A mailer 2 transmitsdistribution items to a mailing service 100. In one embodiment, themailer 2 transmits a distribution item to the mailing service 100 inorder for the mailing service 100 to deliver the distribution item to amail recipient 12. The mailer 2 is not limited to mail preparers andmail owners, and can include a system for sending mail. Systems forsending mail can include, for example, presort mailers who performautomated processing of distribution items from multiple mail owners orcustomers. These systems can receive mail in batches from differentcustomers, combine and sort the batches to obtain postage discounts, andthen transmit the combined mailing to the mailing service 100. Themailer 2 may also transmit data or other information to the mailingservice 100, in addition to transmitting a mailing to the mailingservice 100. In one embodiment, the mailing service 100 transmitsdistribution items back to the mailer 2. In another embodiment, themailing service 100 transmits data or information back to the mailer 2,indicating, for example, receipt of a mailing.

The mailing service 100 can be configured to perform various services onmail transmitted by the mailer 2. Such services are represented byservice modules 110, 120, 130, and 140. Services can include but are notlimited to sorting, tracking, address correction, mail return, mailforwarding, and mail delivery services. The service modules 110, 120,130, and 140 can transmit entire mailings or individual distributionitems to a different service module. In one embodiment, a service module110, 120, 130 or 140 can transmit one or more distribution items back tothe mailer 2. In the embodiment illustrated in FIG. 1, the servicemodule 130 transmits one or more distribution items to the mailer 2. Inanother embodiment, a service module, such as but not limited to theservice module 130, transmits data or other information to the mailer 2.Such data or other information can include for example, information on aservice that is planned to be performed, is currently being performed,or has been performed on one or more distribution items. Similarly, themailer 2 can transmit data or other information directly to the servicemodule 130, or any other suitable service module included in the mailingservice 100.

In one embodiment, the mailing service 100 delivers distribution itemsor a mailing to the mail recipient 12. The mail recipient 12 is notlimited to individuals or businesses, and includes systems for receivingmail. Academic institutions, hospitals, prisons, and other facilitiesmay encompass such systems for receiving mail, for example. In oneembodiment, the mailing service 100 transmits data or other informationto the mail recipient 12, including but not limited to data orinformation on distribution items scheduled to be delivered to the mailrecipient 12. In another embodiment, the mail recipient 12 transmitsdistribution items or a mailing to the mailing service 100. The mailingrecipient 12 may also transmit data or other information to the mailingservice 100. In yet another embodiment, the mailing service 100transmits data or information to the mailing recipient 12, indicating,for example, receipt of a mailing from the mailing recipient 12. In yetanother embodiment, a service module, such as but not limited to theservice module 140, transmits data or other information to the mailrecipient 12. Similarly, the mail recipient 12 can transmit data orother information directly to the service module 140, or any othersuitable service module included in the mailing service 100. Whileembodiments described herein refer to a mailer 2 and mailing service100, it should be appreciated that embodiments described herein may beapplicable to any sort of item that may be distributed by a number ofdifferent types of entities.

As described above, a mailer may wish to encourage or provide additionalinformation or offerings beyond what is cost effective or possible toprovide with a physically delivered distribution item. While adistribution item may include information that provides instructions orrequests for how a recipient may be provided with further information orservices, in many scenarios, the recipient may be unwilling or unable totake further action due to inconvenience or difficulty. As such, theservices and offerings provided by a mailer to a recipient may belimited to the contents of the distribution item itself. As such,providing method and systems for obtaining the participation of arecipient in additional interactive offerings is desirable. Moreover,expanding the user experience associated with receiving a distributionitem may allow mailers to expand advertising and other opportunitiesassociated with sending distribution items.

According to one embodiment, an expanded user experience may be providedto a recipient 12 of the distribution item by using information affixedto a distribution item. This information may be information already beaffixed to the mail piece and used to route, track, and sort packages ina mailing system 100. This information may also be affixed to thedistribution item 8 for the purpose of being used to provide access toexpanded offerings associated with the distribution item 8. For example,a mailer 2 of a distribution item may desire to provide a recipient 12with further information or additional offerings associated with adistribution item in addition to the content of the distribution itemitself. For example, a mailer 2 who mails a product offering may wish toencourage a recipient 12 to look at other product offerings in additionto any product offering included in a mailing. Additionally, a mailermay wish to encourage a recipient to participate in an interactiveoffering that is available via the Internet or take advantage of anonline service associated with a mail piece that would ask the recipientto follow instructions included in the distribution item.

FIG. 2 shows an example of a system for providing content associatedwith a distribution item 8 to the recipient 12 of a distribution item 8by using an information item 10 affixed to or printed on thedistribution item 8. The distribution item 8 may include a letter, apostcard, a package, or the like. A recipient 12 may be an individual orany entity to which a distribution item 8 may be addressed. In addition,while the information item 10 is shown as a barcode, the informationitem 10 may include one or more of encoded values, postage 22, permits,mailing system markings, images, short-range wireless objects (e.g.,objects using RFID and near field communication (NFC)), and any otherinformation or indicia that can be used in some way to identifyinformation about a distribution item 8 or content associated therewith.Affixing an information item 10 may refer to information that isattached, printed, imprinted, embossed, provided, delivered along with,or any other method of providing information with a distribution item 8that allows a computing device to extract and/or derive data from theinformation item 10.

The information item 10 and other information may allow association ofthe distribution item 8 and/or contents thereof with additional contentthat may be determined by the mailer 2 or operator of the mail service.The content may include further information, service offerings,interactive service offerings, tracking information, or the like as willbe further described below. This content may be identified byinformation stored in a remote server 18 which is able to identifycontent associated with information derived from the information item 10provided with the distribution item 8. As such, the information item 10may be configured to be in a machine readable (or machine extractable)format. A computing device 14, operated by the recipient 12, may be usedto process the information item 10 (e.g., a barcode 10, postage 22, etc)to extract and/or derive data from the information item 10. Thecomputing device may send the derived data over a network 16 to retrievecontent associated with the distribution item 8 and/or contents thereof.The computing device 14 may be a smart phone, a PDA, a laptop, a desktopcomputer, a tablet computer, or the like. The data derived from theinformation item 10 may then be provided by the computing device 14 to aserver 18, such as a web server, to retrieve the content or anindication of content associated with the distribution item. The remoteserver 18 may be associated with the entity operating the maildistribution service. The remote server 18 may also connect with a thirdparty server 28 to access and/or generate content using information sentfrom the computing device 14 as will be described in further detailbelow. The remote server 18 may then deliver the content to thecomputing device 14 over the network 16.

In one embodiment, a message provided by the server 18 may include alink to content associated with the distribution item 8 and/or thecontents thereof. The link may be used by the computing device 14 toaccess additional content and/or services. For example, a link tocontent may be a uniform resource locator (URL) that allows a webbrowser on a computing device 14 to load additional content. In otherembodiments, content such as media files may be delivered directly tothe computing device 14 by the remote server 18.

As just described, the computing device 14 may use the information item10 to provide additional interactive services and offerings associatedwith the distribution item 8 such as online content, applications, andfurther offerings. In one aspect, the content may be referred to as“augmented reality,” as the information item 10 on a distribution item 8may be used to provide a virtual or augmented experience with respect toa fixed piece of information or image (that may be the information item10) affixed to a distribution item 8. For example, the content providedto the recipient using the computing device 14 may provide an expandedvirtual experience for an image affixed to a distribution item. In otherwords, the distribution item 8 may provide a direct way to augment itscontents via the computing device 14. As such, a mailer 2 may setupaccess to additional services or offerings' to any recipient 12 with acomputing device 14.

As will be further described below, the mailer 2 may thus expandofferings and information associated with a mailing, while a recipientable to decode the information may be able to more easily andconveniently access interactive content and additional servicesassociated with a received distribution item 8. In one aspect, using aninformation item 10 provided by the mailing service or other type ofdistribution entity (e.g., the U.S. Postal Service) may allow for usinginformation already needed and/or obtained by the distribution entity toroute and send the distribution item 8 to additionally allow foradditional content. This may allow a mailer 2 to avoid having to developand design other proprietary systems for provided expanded content tothe user associated with the mail piece. As such, there may be manyadvantages to using an information item 10 provided by the distributionentity to route and send packages to additionally provide a mechanism toprovide a recipient 12 with interactive services/offerings associatedwith the contents of a distribution item 8.

The development contemplates a wide variety of content and/or servicesthat may be provided according to the system described in FIG. 2 asfurther disclosed by the description below. According to one embodiment,a distribution item 8 may include an advertisement for a product oroffering. When the recipient processes an information item 10, such abarcode, with the computing device 14 the computing device 14 maypresent the recipient with additional information about the advertisedproduct or may provide an additional discount for product purchase tothe recipient. Further examples of the types of content and offeringsthat may be available are described below.

FIG. 3 shows a flowchart of an exemplary method 300 for providingcontent associated with a distribution item 8 to a recipient 12 using acomputing device 14 operated by the recipient 12 as shown in FIG. 2. Inone embodiment, the method 300 may begin after a distribution item withan information item 10 is received by a recipient 12. The informationitem 10 may be any of items described above, such as an encoded value(e.g., a barcode), or as those described below. In block 302, acomputing device 14 processes the information item 10. The processingmay include capturing information about the encoded value, and decodingor preparing the encoded value so that it may be used by a networkservice to determine information associated with the mail piece as willbe further described below. In one embodiment, processing theinformation item 10 may include capturing an image of at least a portionof the distribution item 8 including the information item 10 andperforming image processing to extract information from the image. Ifthe information item is an image, processing may include performingimage recognition. In addition, if an information item 10 includesalphanumeric characters, processing may include capturing an image ofthe information item 10 and performing optical character recognition(OCR). Furthermore, if an information item 10 is stored within an RFIDtag (not shown), processing may include reading the contents of the RFIDtag with an RFID tag reader in the computing device 14. Those of skillin the art will appreciate the variety of methods that may be used toprocess an information item 10 associated with a distribution item 8using a computing device 14.

After processing the information item 10, in block 302, the computingdevice 14 may transmit a message with the processed data determined fromthe information item 10 to a network service as depicted in block 304.In one embodiment, the network service may be provided, for example, bya remote server 18. In another embodiment, the network service may beprovided by a cloud service. In some embodiments, the processed data maybe an image of the information item 10 prepared for decoding/performingimage recognition by the network service. In other embodiments, theprocessed data may be a decoded or partially decoded value which may beused by the network service to determine information associated with thedistribution item 10, as will be described in further detail below.

In block 306, the computing device 14 may receive a message includinginformation associated with the distribution item 8. This informationmay be provided in a variety of forms, such as text viewable on thecomputing device 14, a link to further content accessible via a webbrowser on the computing device 14, media files, or other informationthat may be used by the computing device 14 to access informationassociated with the mail piece 8. It should be appreciated that block306 is optional, as in some embodiments, the computing device 14 maydetermine content associated with the distribution item without relyingon a network service. In block 308, the computing device may then usethe information to provide content and/or services associated with thedistribution item 8. For example, if the information received is a URL,the computing device 14 may be automatically triggered to open up a webbrowser that will provide functionality for displaying the contentassociated with the link. If the information received is content, anapplication on the computing device 14 may be configured to display thecontent to the user. If the content is audio-based content, thecomputing device 14 may play the audio using internal or integratedspeakers. In some embodiments, the content may trigger a computingdevice 14 to provide haptic feedback. Further examples of the types ofcontent, services, and offerings that may be provided via the computingdevice will be further described below. The method shown in FIG. 3 maybe repeated for additional distribution items with associatedinformation items.

FIG. 4A shows a flowchart of an exemplary method for determining contentassociated with a distribution item 8 using data derived from aninformation item 10 affixed to the distribution item 8. In block 402, anetwork service may receive a message with data obtained from aninformation item 10 affixed to a distribution item 8. The data mayprovide information to identify the source of the mailer, a particulartype of mailing, information about the contents of the distribution item8, a unique identifier of the distribution item 8, and the like.Furthermore, the message may include other information regarding thecomputing device 14. For example, the message may include thegeographical location of the computing device 14, the date/time,proximity to an object, or previous actions of a user.

In block 404, the network service may determine information associatedwith the distribution item 8 using the received data. The data may beused to identify targeted/customized content associated with thedistribution item 8. In some embodiments, the content associated withthe distribution item 14 may be pre-stored and may be accessed via astorage mechanism such as a database. In another embodiment, the contentmay be dynamically generated based on the data. In one embodiment, thenetwork service may perform additional processing on the data receivedin order to further identify the distribution item and contentassociated therewith. For example, if the data includes an image, thenetwork service provider may be configured to perform image recognitionto determine the contents of the image in order to know what content isassociated with the distribution item 8. Once content has beenidentified, then in block 406, the network service transmits a messagewith the determined information associated with the distribution item 8to a computing device 14.

FIG. 4B shows another flowchart of an exemplary method for determiningcontent associated with a distribution item 8 using data derived from aninformation item 10 affixed to the distribution item 8. As in block 402of FIG. 4A, in block 412, a network service may receive a message withdata obtained from an information item 10 affixed to a distribution item8. In block 414, received data is transmitted to a third party networkservice. The third party network service may be located on anotherserver 22, or may be a cloud service, or the like. In one embodiment,further processing of the received message may be performed by thenetwork service before transmitting the received data to the third partynetwork service. For example, if the message includes an image, thenetwork service may perform image recognition on the image to determineddata associated with the distribution item 8. The data may then betransmitted to the third party network service once processed.

The third party network service may be operated by the mailer 2 of thedistribution item 8. In this way the mailer 2 may be able to providetargeted content to a recipient 12 based on information received fromthe mailing service that is transmitted to the mailing service when therecipient processes the information item 10 with a computing device 14.In addition, as described above, in one embodiment, the information item10 may be provided by the mailing service or other distribution entityready to route and send the distribution item 8. In this way mailer 2may be able to take advantage of the existing information to furtherprovide additional targeted content to a recipient 12 without additionalinformation. In block 416, the network service may receive a messagefrom the third party network service with information associated withthe distribution item 10. In block 418, the network service transmits amessage with the information associated with the distribution item tothe computing device 14. In some embodiments, the third party networkservice may directly provide content to the computing device 14 ratherthan transmitting information to the network service.

FIG. 5 shows a flowchart of an exemplary method for retrievinginformation associated with a distribution item 8 including aninformation item 10. In block 502, the method begins when an image of aninformation item 10 affixed to a distribution item 8 is received and/orcaptured using a computing device 14 equipped with a digital camera orwebcam. In one embodiment, the computing device 14 may be a smart phonewith an integrated digital camera, a personal computer with an attacheddigital camera device, a laptop computer with an integrated digitalcamera, a tablet computer, or any other computing device 14 capable ofcapturing and processing images. Once an image of the information item10 has been received by the computing device 14, in block 504, thecomputing device 14 interprets the image to generate data determined bythe image of the information item 10. For example, as will be furtherdescribed below, an image of a barcode may be interpreted to generatedecoded alphanumeric values determined by the barcode image.

Once the data has been determined, the data is transmitted to a networkservice in block 506. The computing device 14 may thereafter receive aresponse from the network service 508. The response may indicate whethervalid data associated with a distribution item 8 was received andwhether there is content associated with the distribution item 8. Inblock 510, a computing device 14 processes the message and determineswhether a content indicator has been received. The content indicator maybe, for example, a uniform resource locator (URL) which can be used by aweb browser on the computing device 14 to retrieve and display content.If a content indicator was received in the response from the networkservice, in block 512, the content associated with the distribution item8 may be displayed on the computing device 14 by using the contentindicator. As described above, in another embodiment the network servicemay provide actual displayable and or usable content directly to thecomputing device 14 rather than just providing a link. The method thenconcludes at block 520, until the computing device 14 captures and/orreceives another image of an information item 10.

If a content indicator was not included in the response, the methodcontinues at block 514 where the computing device 14 determines whetherthe response included an indication that the information item 10 wasinvalid. If the response indicates the information item 10 was invalid,the method proceeds to block 516 where the computing device 14 displaysa message indicating that the image received was invalid. If no contentindicator was received and there was no indication that the informationitem 10 was invalid, then the computing device 14 may determine thatthere was no content associated with the distribution item 8. In thiscase, as shown in block 518, the computing device 14 may display amessage indicating that no content associated with the distribution item8 was identified by the network service.

FIG. 6 shows a flowchart of an exemplary method for determining contentassociated with a distribution item 8 using data derived from an imageof an information item 10. According to one embodiment, the method shownin FIG. 13 may be performed by a network service on a remote server 18,such as a web service. In block 602, the method may begin when a server18 receives data indicating information about a distribution item 8 froman image of an information item 10 affixed to the distribution item 8.In some embodiments, the server may perform additional processing of thedata to extract or determine other data indicating information about adistribution item 8.

The data is validated in block 604 to ensure that the data correspondsto an acceptable value and that it may be accurately associated with adistribution item 8. Some validation may also take place when performingany additional processing. Validation may include determining whethereach numerical value for a field of an information item 10 is within adetermined range of values or may use other validation techniques, whichwill be appreciated by a person/one having ordinary skill in the art. Inblock 606, the server determines whether the data is valid. If the datais invalid, a message is prepared indicating that the informationreceived was invalid in block 610.

If the data from the information item 10 is valid, then in block 608,the network service uses the data to query a database for contentassociated with the distribution item 8. The database may be local tothe server or may be at a remote location from the server. In block 612,the network service determines whether the query to the databasereturned any content associated with the distribution item 8. If thequery response indicated that there was no content associated with thedistribution item 8, the network service may prepare a messageindicating that no content associated with the distribution item 8 wasfound at block 614. If the query response contained content associatedwith the distribution item 8, then in block 616, a message is preparedwith the content or a link to the content returned by the query. Asdescribed above, the database may return either a link to content, suchas a URL, or actual content that may be used by a computing device 14.The appropriate message, generated by either blocks 610, 614, or 616 isthen transmitted to a computing device 14 shown in block 618. Theprocess ends in block 620.

As described with reference to FIGS. 5 and 6, the computing device 14may interpret data retrieved from an information item 10, such as animage, to generate data determined by the information item 10. It shouldbe appreciated that this operation, and other similar operations thatmay be performed to provide the data may be done either entirely on thecomputing device 14, entirely by a network service, or any combinationthereof. FIGS. 7 and 8 show examples of embodiments where processing aninformation item 10 is performed either on the server 18 or on thecomputing device 14.

FIG. 7 shows a flowchart according to an exemplary system where imageprocessing (or other such processing of an information item 10) isperformed by the computing device 14 used to capture an image of theinformation item 10. In block 722, the computing device 14 in FIG. 7captures an image of an information item 10. In block 724, the computingdevice 14 interprets the image. If the image is an encoded value,interpreting the image may include performing decoding steps and othersimilar functions. Furthermore, the computing device may perform OCR toextract textual information from the image. According to anotherembodiment, the computing device 14 may perform image recognitionalgorithms, if an information item 10 includes an image. In block 726,the computing device 14 determines whether the information item 10 wassuccessfully processed to extract valid information. If the informationitem 10 was successfully processed, then the data providing informationabout the distribution item 8 is transmitted to a server 18 thatincludes a web-service 706 in block 730. If information item 10 was notsuccessfully generated, the computing device 14 may display a messageindicating such to a user in block 728. Otherwise, the computing device14 waits for a response from the server 18 in block 732. Once theresponse is received, then the computing device 14 may display theresponse or data associated with the response (e.g., the contents of alink using a web browser) on the computing device 14 as depicted inblock 734.

Once data derived from the information item 10 is received at theserver's web service 706, in some embodiments, the data may go throughsome additional processing to determine more specific information aboutthe distribution item 8, as depicted in block 736. The server 18 withthe web service 706 may be accessed via a wide area network 708, such asthe Internet. As depicted in block 738, the web service 706 may thendetermine whether there is content associated with the data derived fromthe information item 10, such as for example querying a database asdescribed above with reference to FIG. 6. In block 740, the web service706 transmits the content, if any, to the computing device 14. Thecontent may be a content link 710 which may be used by the computingdevice 14 to view content associated with the mail piece or may be othercontent. According to FIG. 7, the web service that receives data derivedfrom the information item 10 is not required to perform image processingof the information item. Avoiding image processing by the web servicemay reduce latency if the web service is requested to process multiplerequests simultaneously. This may allow for greater scalability as anincrease in requests for content associated with a barcode will haveless of an impact on latency if image processing is performed by thecomputing device 14. Low network latency may improve the user experiencesuch that the process is used more frequently and different and diverseapplications might be more easily developed for custom imageinterpreters built for different devices.

FIG. 8 shows a flowchart according to an exemplary system where imageprocessing is performed by a web service 806 on a server 18, rather thanby the computing device 14 used to capture an image of an informationitem 10. The computing device 14 in FIG. 8 captures an image of aninformation item 10 in block 822 and additionally may perform somepre-processing of the image. The computing device 14 determines if theimage is captured successfully as depicted at block 824. If the imagewas captured successfully, then data 804 including the image istransmitted to the server 18 in block 828 that includes a web service806. If the image was not successfully captured, the computing device 14may inform the user in block 826. The computing device 14 then waits fora response in block 830. Once the response is received, then thecomputing device 14 may display the response or data associated with theresponse (e.g., contents of a link) on the computing device 14 asdepicted in block 832.

Once the image of the information item 10 is received at the web service806, the image is interpreted to generate data derived from theinformation item 10 at block 834. As described above, the imageprocessing may include any number of algorithms configured to recognizebarcodes or other encoded values, perform OCR, perform image recognitionalgorithms, and the like. The web service may be accessed via a widearea network 808, such as the Internet. In block 836, the methoddetermines whether there is content associated with the data derivedfrom the information item 10, for example by querying a database asdescribed above. The server 18 then transmits the content, if any, tothe computing device 14 at block 838. The content may be a content link810 which may be used by the computing device to view content associatedwith the mail piece or it may be other content. According to FIG. 8,barcode interpretation and decoding are both preformed by the networkservice. In one aspect, according to this architecture, all clientcomputing devices may reuse image interpretation processes as it wouldbe performed on a server. This embodiment may allow for a large numberof client computing devices with capabilities of acquiring images of aninformation item 10, to access content associated with a distributionitem 8 without having to incorporate native image interpretationprocesses for each client device. On the other hand, this architecturemay increase latency as multiple requests to interpret images may haveto be processed by the network, rather than done individually by eachrequesting client computing device 14.

It should be appreciated that the network architectures shown in FIGS. 7and 8 describe just two examples of the division of responsibility forperforming the operations necessary for decoding an image of aninformation item 10 and retrieving content associated therewith andother embodiments are possible. For example, the computing device 14 maybe configured to partially decode an encoded value and then beconfigured to transmit this data to a network service. Additionally,further validation may be able to occur on the computing device 14 thatmay improve scalability of the system where less processing is requiredby the network service.

Intelligent Barcodes

A wide variety of different types of information items that may beincluded with a distribution item 8 and used to derive data to identifyinformation about the distribution item 8 are contemplated by thedevelopment. One type of information item 10 that may be printed oraffixed to a distribution item 8 may include a barcode. A barcode mayinclude a variety of different types of barcodes such as 1D, 2D, and 3Dbarcodes. FIG. 9 illustrates an intelligent barcode 30 that can be usedin systems according to embodiments of the development. An intelligentbarcode 30 can be affixed on a distribution item 8 and used to sort andtrack the distribution item 8. In one embodiment, the intelligentbarcode 30 is printed directly on an outer surface of the distributionitem 8. In another embodiment, the intelligent barcode 30 is stampeddirectly on an outer surface of the distribution item 8. In yet anotherembodiment, a mailer prints the intelligent barcode 30 on a label, andthen affixes the label to an outer surface of the distribution item 8.In still another embodiment, the mailer prints intelligent barcode 30 ona piece of correspondence, and then inserts the correspondence inside anenvelope such that the intelligent barcode 30 is visible through a clearor see-through window in the envelope. In one embodiment, the window iscovered with clear cellophane and the intelligent barcode 30 is visiblethrough the cellophane. The intelligent barcode 30 can be used with anydistribution item 8 having such a window, not just envelopes. Inaddition to sorting and tracking systems, intelligent barcode 30 canalso be used with and in other systems and methods described herein.

FIG. 10 illustrates an example of other types of barcodes 40, 50. Thebarcodes 40 and 50 are optical machine-readable representations of data.The barcodes 40 and 50 illustrated in FIG. 10 are height-modulated suchthat the data representation consists of evenly spaced bars of varyingheight. The barcode 40 illustrated in FIG. 10 is a two-state barcode inwhich data is encoded using two types of bars—short bars 26 and tallbars 24. The intelligent barcode 30 shown in FIG. 9 in one embodiment ofthe development is a height-modulated four-state barcode, in which datais encoded using four types of bars. In the embodiment illustrated inFIG. 9, the four bar types are descender bars 32, tracker bars 34, fullbars 36, and ascender bars 38.

Different barcodes may include different information. For example,referring to FIG. 10, the barcode 40 may be configured to includetracking information, while the barcode 50 may be configured to includesorting information. A mailer 2 may need to place both barcodes 40 and50 on a single distribution item 8 to allow the mailing service to sortthe distribution item 8 when it is first introduced into the mailingsystem, as well as allow the mailing service and the mailer to track thedistribution item 8 along its route to an ultimate destination. Sortinginformation can include, for example, a ZIP™ Code, which can be used todetermine a delivery point mailing address. Tracking information cangenerate, for example, distribution item 8 processing data used fortracking purposes when the distribution item 8 is processed on automatedmail processing equipment. In some embodiments, using both barcodes 40and 50 adds complexity and requires extra information and processing. Incontrast, the intelligent barcode 30 shown in FIG. 9 may be designed foruse in high-speed, automated mail sortation machines. As will bedescribed and shown in the figures referenced below, information frombarcodes 40 and 50 can be combined and represented by a singleintelligent barcode 30 that includes encoded data representing valuesstored in barcodes 40 and 50. For example, tracking and sortinginformation can be combined into one intelligent barcode 30. Using oneintelligent barcode instead of two prior art barcodes can free up moreopen space on the distribution item 8, save printing costs such as butnot limited to ink costs, and simplify production.

In addition to the capability to combine data from multiple barcodes,the intelligent barcode 30 may offer expanded data capacity comparedwith prior art barcodes. This expanded data capacity can include, forexample, expanded tracking capabilities. The current data capacity ofprior art barcodes will first be described.

Referring now to FIG. 11A, the barcodes 40, 50 contain human readablerepresentations of numerical digits. In one embodiment, the barcode 40is a thirteen-digit barcode that can be used in combination with thebarcode 50, another thirteen-digit barcode, to uniquely identify thedistribution item 8. The barcodes may begin and end with frame bars 42.While shown as a corresponding to two thirteen digit barcodes, thebarcodes 40 and 50 can be adapted and configured to include any numberof digits, including but not limited to 11 or 13 digits.

As shown in FIG. 11B, one combination of five tall and short barsrepresents the digit 0, a different combination of five tall and shortbars represent the digit 1, and so on to digit 9. The barcodes 40 and 50may use different combinations of short bars 26 and tall bars 24 torepresent the same digits, or, as demonstrated in the embodimentillustrated in table 45, the digit symbology for the barcode 40 may bethe inverse of the digit symbology for the barcode 50. The barcodes 40and 50 may also include a check-sum digit 46 configured to detect errorsin the barcodes.

The types of data that can be represented in the barcodes 40 and 50 willnow be described in further detail with reference to the barcode 40illustrated in FIG. 11A. Following the framing bars 42, the first twodigits in the barcode 40, “40,” can represent data such as, but notlimited to, the service type and the class/shape of the mail. Servicetypes can include, for example, First-Class Mail, Standard Mail, andPeriodical Mail. The class/shape of the mail can include, for example,letters, flats, and cards. Thus, in one embodiment, the first two digitscan represent a Service Type Identification (ID) for the distributionitem 8. A Service Type ID of “40” can represent First-Class Mailletters, while a Service Type ID of “43” can represent Standard Mailflats in one example.

The next five digits in the barcode 40, “12345,” can identify a mailpreparer, a mail owner, a subscriber to a particular mailing systemservice, or a system for sending mail. In one embodiment, this number isa Subscriber ID assigned by the mailing service to a subscriber toidentify that a particular distribution item 8 was mailed by aparticular subscriber. Further, the subscriber's particular tracking andhandling preferences can be stored in records kept by the mailingservice. In some embodiments, these preferences or settings can be usedto identify the particular handling a distribution item 8 shouldreceive. Systems to match a particular distribution item 8 with aparticular mailer and the mailer's preferences will be described ingreater detail below.

The next six digits in barcode 40, “235636,” can be made available tothe mailer to use for identification purposes. The number may be used toidentify a particular distribution item 8, client, or account, forexample. Mailers can use these six digits in combination with thebarcode 50 to identify the distribution item 8 uniquely. The last digit,“6,” represents a check sum or correction character to detect errors inthe barcode. In some embodiments, the check sum digit is thesingle-digit number (0 to 9) that, when added to the sum of the otherdigits in the barcode 40, results in a whole number that is a multipleof 10.

The types of data that can be represented in the intelligent barcode 30will now be described in further detail. FIG. 12 illustrates anintelligent barcode 30 according to embodiments of the development. Theintelligent barcode 30 can be divided into multiple fields, such as butnot limited to fields 1250, 1260, 1270, 1280, and 1290. In oneembodiment illustrated in FIG. 12, the field 1290 contains 11 digitswhich represent routing or destination data that can be used to sort androute a distribution item 8. In other embodiments, field 1290 contains0, 5, or 9 digits. For example, the field 1290 can accommodate 0, 5, 9,or 11 digits of ZIP™ Code information, also known as a delivery pointZIP™ Code, associated with a mail recipient 470, or addressee.

A field 1280 may contain 9 digits representing a mailing identification(ID), or serial number. In some embodiments, the field 1280 is availableto the mailer 2 to use for its own identification purposes and is thusconsidered “open” by the mailing service 100. The digits can uniquelyidentify, for example, a particular distribution item 8, a particularmailing, or a particular client.

A field 1270 may contain a six-digit code which, in some embodiments, isnot considered “Open” by the mailing service 100. The field 1270 mayinclude, for example, a mailer identification (ID), also known as asubscriber ID. This mailer ID/subscriber ID can be assigned to themailer 2 by the mailing service 100 to identify a particular mailer or aparticular subscriber to a service offered by the mailing service 100.In some embodiments, mailers 410 who were assigned a five-digitSubscriber ID to use in barcodes 40, as discussed above, can add aleading zero to their Subscriber ID to represent a six-digit SubscriberID for use in the intelligent barcode 30.

In one embodiment, the mailer ID is a six-digit number that uniquelyidentifies the mailer 2. According to one example, if the mailer ID is asix-digit number, the mailing ID is limited to nine digits. Thus,according to this example, there are 1 billion unique nine-digit mailingIDs available for mailers 410 using a six-digit mailer ID. In anotherembodiment, the mailer ID is a nine-digit number that uniquelyidentifies the mailer 2. According to this example, if the mailer ID isa nine-digit number, the mailing ID is limited to six digits. Thus,according to one example, there are 1 million unique six-digit mailingIDs available for mailers 410 using a nine-digit mailer ID.

According to one aspect of the development, the mailing service 100assigns the mailer 2 a mailer ID based on the volume of mail the mailer2 transmits annually to the mailing service 100. In one embodiment, amailer 2 who mails 10 million or more distribution items annually willbe assigned a six-digit mailer ID. The mailer 2 can request additionalsix-digit mailer IDs to satisfy additional mailing needs. In anotherembodiment, a mailer who mails less than 10 million distribution itemsannually will be assigned a nine-digit mailer ID. The mailer 2 canrequest additional nine-digit mailer IDs to satisfy additional mailingneeds. In yet another embodiment, six-digit mailing IDs assigned by themailing service 100 begin with numbers “0” through “8,” and nine-digitmailing IDs assigned by the mailing service begin with the number “9.”

A field 1260 may contain a 3-digit code identifying the specific servicethe mailer 2 has selected for the distribution item 8. For example, thefield 1260 may contain a service type identification (ID) thatidentifies the mailer 2 requests destination confirm service for thedistribution item 8, or alternatively, origin confirm service for thedistribution item 8. The Service Type ID can also identify the mailclass of the distribution item 8, such as but not limited toFirst-Class, Standard, and Periodicals mail. The mail class canindicate, among other things, what class of service or treatment thedistribution item 8 should be given, based on the mailer 2's indicationof a particular mail class. Table 1 illustrates possible classes ofservice for a distribution item 8 according to one embodiment.

TABLE 1 Service Type ID Class/Shape of Mail 040 First-Class Mail letters041 First-Class Mail flats 042 Standard Mail letters 043 Standard Mailflats 044 Periodicals letters 045 Periodicals flats 046 First-Class Mailcards 047 Standard Mail cards

Thus, for example, a Service Type ID of “040” in the field 1260 canrepresent the mailer's 2 selection of Destination Confirm First Classtreatment for a letter distribution item 8. Similarly, a Service Type IDof “042” can represent the mailer's 2 selection of Destination ConfirmStandard Mail treatment for a flat distribution item 8. In oneembodiment, all distribution items requesting origin confirm servicehave “050” in the field 1260, regardless of the mail class of thedistribution item 8.

In one embodiment, the mailer 2 identifies a mail class for adistribution item 8 using a specific Service Type ID, and therebyrequests special services for the distribution item 8 such as trackingor address correction services. Special services can include trackingand address correction services for mailers 2 who use the intelligentbarcode 30, such as for example, OneCode Confirm™ and OneCode ACS™.According to one embodiment, OneCode Confirm™ is a tracking service,such as a destination and/or origin confirm service, offered to themailer 2 who requests such tracking and/or confirm services in theService Type ID of the intelligent barcode 30 applied to itsdistribution items. According to another embodiment, OneCode ACS™ is anaddress correction service offered to the mailer 2 who requests suchaddress correction services in the Service Type ID of the intelligentbarcode 30 applied to its distribution items.

In another embodiment where the mailer 2 does not identify a mail classfor the distribution item 8 or request special services, the ServiceType ID can be used by the mailing service 100 to apply automation ratediscounts. Thus, the mailer 2 who does not request special services maystill receive an automation rate discount in accordance with the ServiceType ID in the intelligent barcode 30 applied to a distribution item 8.

A field 1250 may contain a 2-digit code for internal use by the mailingservice 100. In one embodiment, mailers 410 may populate the field 1250with two zeroes. In some embodiments, the field 1250 is reserved forindicating an optional endorsement line sort level and exceptionhandling. For example, in one embodiment, optional endorsement line andexception handling information encoded in the intelligent barcode 30provide instructions to the mailing service 100 on disposition of adistribution item 8. In another embodiment, the mailing service 100treats a distribution item 8 in accordance with optional endorsementline and exception handling instructions for a fee.

In one embodiment, the mailer 2 “seeds” outgoing mailings with anintelligent barcode 30 attached to some distribution items, but notevery distribution item 8. The mailer 2 can use data from the seededdistribution items to make assumptions about the entire mailing. Forexample, in one embodiment, the mailer 2 seeds every tray of a mailingwith five destination confirm intelligent barcodes 30 attached to fivedistribution items. The mailer 2 can receive information from themailing service 100 about the seeded distribution items to makeassumptions about the entire tray. The mailer 2 can choose the seedquantity and coverage to meet its specific needs. For example, theseeded mail may indicate a common geographic location for eachdistribution item 8. Based on this information, the mailing service maymake the assumption that all distribution items in the tray are destinedfor the same general location. As another example, the intelligentbarcode may include information that uniquely identifies a specificoffering or service for each distribution item 8 in the tray sent todifferent recipients. In this case, the five seeded intelligent barcodesmay allow the assumption that every distribution item 8 in the trayincludes the same specific service or offering.

In another embodiment, the mailer 2 seeds outgoing mailings by placingintelligent barcodes 30 on Confirm™ Smart Seed™ distribution items inthe mailing. In one embodiment, Confirm™ Smart Seed™ is a serviceoffered by the mailing service 100 that allows the mailer 2 to receivemail processing equipment scan data for the mailing without applying theintelligent barcode 30 to distribution items that will be delivered tocustomers. Thus, in one embodiment, the mailer 2 obtains the benefit ofseeding using intelligent barcode technology without attaching theintelligent barcode 30 to its distribution items. Further embodimentsand details of destination confirm services offered by the mailingservice 100 according to one embodiment are described in U.S. PostalService, Confirm Service Featuring One Code Confirm: Publication 197(2008), which is hereby incorporated herein by reference.

In some embodiments, the combination of Mailing ID digits in the field1280 and the Subscriber ID digits in the field 1270 make the intelligentbarcode 30 unique to the particular distribution item 8 to which it isaffixed. Thus, the combination of Mailing ID and Subscriber ID in theintelligent barcode 30 may be a unique distribution item 8 identifier.In some aspects, it is desirable to maintain distribution item 8uniqueness for a specific period of time. Maintaining distribution item8 uniqueness can assist the mailing service 100 to sort and trackdistribution items, for example. In one embodiment, the mailing service100 instructs the mailer 2 to maintain distribution item 8 uniquenessfor a specific period of time, including but not limited to 10, 25, 30,45, 50, or 60 days. In another embodiment, the specific period of timeduring which distribution item 8 uniqueness must be maintained is 45calendar days.

In another embodiment, the mailer 2 uses the intelligent barcode 30bearing Mailing ID “X” and Subscriber ID “Y” on a first distributionitem 8. The mailing service 100 instructs the mailer 2 not to reuse thissame intelligent barcode 30 bearing Mailing ID “X” and Subscriber ID “Y”on a second distribution item 8 within 45 calendar days of the date thefirst distribution item 8 was inducted into the mailing system 400. Inyet another embodiment, the mailer 2 may not use the intelligent barcode30 bearing Mailing ID “X” and Subscriber ID “Y” on two pieces of mail inthe same mail category within 45 calendar days, but may use the sameintelligent barcode 30 bearing Mailing ID “X” and Subscriber ID “Y” ontwo distribution items in different mail categories within 45 calendardays. Thus, in this embodiment, distribution item 8 uniqueness is notmaintained across mail classes, and two distribution items can carry thesame Mailing ID and Subscriber ID combination within the same 45-dayuniqueness period as long as they are in different mail classes.

Persons of skill in the art will understand that multiple fields in theintelligent barcode 30 can be used to maintain distribution item 8uniqueness, not just the Mailing ID and Mailer/Subscriber ID. Thus, inone embodiment, the combination of Service Type ID, Mailer/SubscriberID, and Mailing ID is used to maintain distribution item 8 uniquenessacross mail classes, but not within the same mail class. For example, inone embodiment the same Mailing ID and Subscriber ID is used on twodistribution items in different classes of mail, and the distributionitems bear different Service Type IDs in the intelligent barcode 30. Inthis example, the Service Type ID, and particularly the combination ofService Type ID, Mailer/Subscriber ID, and Mailing ID, is used touniquely identify the distribution items.

Because maintaining distribution item 8 uniqueness can improve themailing service's sorting and tracking services and systems, the mailingservice 100 may incentivize mailers 410 to use unique, intelligentbarcodes 30 on their mailings. Such incentives may be called “automationdiscounts.” In one embodiment, the mailing service 100 offers reducedpostal rates to mailers 410 who apply the intelligent barcodes 30 totheir mailings. Other incentives, such as but not limited to theprovision of advanced tracking information to the mailer 2, theprovision of address correction information at no or reduced cost, andforwarding of undeliverable-as-addressed (UAA) mail at no or reducedcost.

In one embodiment, the mailer 2 applies unique, intelligent barcodes 30to individual distribution items. In another embodiment, the mailer 2also applies unique, intelligent barcodes to each handling unit used totransport individual distribution items to the mailing service 100.Handling units can include, for example, trays, tubs, sacks, or bundles.The intelligent barcode 30 that is applied to a handling unit may takethe same or similar form to that described above with respect to theintelligent barcode 30 for distribution items, or it may take anotherform. In some cases, the mailer 2 has a large number of handling unitsand uses containers to transport the handling units to the mailingservice 100. In yet another embodiment, the mailer 2 also appliesunique, intelligent barcodes to distribution items, handling units, andthe containers used to transport handling units to the mailing service100. Containers can include, for example, pallets, gaylords, and AllPurpose Containers (APCs). An intelligent barcode affixed to a handlingunit or a container can include information common to all distributionitems in the handling unit or the container. For example, theinformation encoded on the barcode for a handling unit might indicateeither that every distribution item 8 is destined to the same generallocation or it might indicate that each of the distribution itemsincludes the same contents.

In some aspects, the mailer 2 generates and transmits a statement, suchas a postage statement to the mailing service 100 using an approvedelectronic method. The statement may indicate a number of pieces beingmailed and the accompanying price for each of the pieces. Thesestatements can be transmitted before or at the same time thedistribution items are transmitted to the mailing service 100 to be ableto track payment information and other data associated with mailing thedistribution items. In other aspects, the mailer 2 generates andtransmits mailing documentation to the mailing service 100 using anapproved electronic method. This mailing documentation can betransmitted before or at the same time the distribution items aretransmitted to the mailing service 100. In one embodiment, the mailingdocumentation describes how individual distribution items are linked tohandling units, and how handling units are linked to containers, whencontainers are used. The mailing documentation may be used to allow themailing service to appropriately track and group distribution items formore efficient distribution. Furthermore, the mailing documentation maybe used to provide the mailer with a reference with respect to a certainmailing so that the mailer may more easily track and obtain informationabout a group of distribution items as the distribution items are beingdelivered. Allowing a mailer to electronically submit mailingdocumentation provides the mailer with an additional tool for accessinginformation with respect to several different mailings. Other servicesand aspects associated with the intelligent barcode are described inU.S. patent Ser. No. 12/405,139 entitled INTELLIGENT BARCODE SYSTEMS,which is hereby incorporated herein in its entirety by reference. Inaddition, further aspects of an intelligent barcode are described in thepublication U.S. Postal Service, A Guide to Intelligent Mail for Lettersand Flats (2008), which is hereby incorporated herein by reference.

As described above, an intelligent barcode 30 provides amachine-readable format that may be used for categorizing andidentifying each distribution item 8. The intelligent barcode 30 may befurther used to associate a distribution item 8 with externallyavailable information, such as online content, applications, and furtherofferings.

FIG. 13 shows a flowchart of an exemplary method for delivering contentassociated with a distribution item 8 with an affixed intelligentbarcode 30 to a computing device 14 as shown in FIG. 2. The method 1300may begin at block 1302 when a distribution item 8 with an intelligentbarcode 30 is received. In block 1304, the intelligent barcode 30 isprocessed using a computing device 14 as described above. The processingmay include capturing information about the intelligent barcode 30, anddecoding or preparing the intelligent barcode 30 so that it may be usedby a network service to determine information associated with thedistribution item 8 as will be further described below. After processingthe intelligent barcode 30, in block 1306, the processed encoded valueis provided to a network service. In some embodiments, the processedencoded value may be an image of the intelligent barcode 30 prepared fordecoding by the network service. In other embodiments, the processedintelligent barcode 30 may be a decoded or partially decoded value whichmay be used by the network service to determine information associatedwith the distribution item 8, as will be described in further detailbelow.

In block 1308, the network service may determine and/or retrieveinformation associated with the distribution item 8 based on theinformation about the intelligent barcode 30 received from the computingdevice 14. The network service may provide the information associatedwith the distribution item 8 to the computing device 14 in block 1310.This information may be provided in a variety of forms, such as textviewable on the computing device 14, a link to further contentaccessible via a web browser on the computing device 14, media files, orother information that may be used by the computing device 14 to accessinformation associated with the distribution item 8. In block 1312, thecomputing device may then use the information to display or providecontent and/or services associated with the distribution item 8 asdescribed above. The method described by FIG. 13 may be repeated for anydistribution item 8 with an encoded value such as an intelligent barcode30.

As such, in one aspect, beyond providing information regarding routingand delivering a distribution item 8 by the mailing service or otherdistribution entity, the intelligent barcode 30 may further provide away for a recipient 12 to be provided with additional interactivecontent or services associated with the distribution item 8. In oneaspect, a mailer 2 may therefore avoid putting additional informationitem on the distribution item 8 besides the intelligent barcode 30already used to allow users to be connected to additional content.Furthermore, the distribution entity may be in an advantageous positionby delivering and handling the distribution item 8 to be able to providethe mailer 2 with systems and opportunities for providing the additionalcontent associated with the mail piece. In addition, the use of theintelligent barcode 30 may provide for both linking a recipient 12 withcontent in addition to providing routing and physical distributionservices. In one aspect, the mailer 2 may be able to create and printintelligent barcodes themselves that will be recognized and used by thedistribution entity to deliver and route distribution items. Inaddition, the intelligent barcode 30 created by the mailer 2 may befurther used to allow a recipient to link to additional content. Variousinterfaces and systems as described herein may be adapted to allow themailer 2 to associate information within the intelligent barcode 30 withadditional content for a recipient 12 such that the intelligent barcode30 is used to both route and deliver the package and provide a way forthe recipient to view expanded content.

The description below provides examples of how an intelligent barcode 30may be decoded and used by a computing device 14 to deliver contentassociated with a distribution item 8 to a recipient 12. In one aspect,processing and decoding the intelligent barcode 30 may correspond tocapturing an image of the intelligent barcode 30 and processing theimage to extract the encoded information. FIG. 14A shows the four typesof bars included in an intelligent barcode 30: a full bar 1402, anascender bar 1404, a tracker bar 1406 and a descender bar 1408.According to one embodiment, the computihg device captures an image ofan intelligent barcode 30 and identifies the type of each bar in theintelligent barcode 30. As shown in FIG. 14A, each bar of an intelligentbarcode 30 may be divided up into three regions: an ascending region1410, a tracking region 1412 and a descending region 1413.

According to one method, these regions may be used to determine the typeof bar included in the intelligent barcode 30. If the computing device14 detects that image data for a bar exists in the ascending region1410, the tracking region 1412 and the descending region 1413, then thecomputing device 14 may identify the bar as a full bar 1402. If thecomputing device 14 detects that image data for a bar exists in only theascending region 1410 and the tracking region 1412, then the computingdevice 14 may identify the bar as an ascender bar 1404. If the computingdevice 14 detects that image data for a bar exists in the trackingregion 1412 alone, then the computing device 14 may identify the bar asa tracker bar 1406. Finally, if the computing device 14 detects imagedata for a bar exists in the tracking region 1412 and the descendingregion 1413, then the computing device 14 may identify the bar as adescender bar 808.

Each of the full bar 1402, ascender bar 1404, tracker bar 1406 anddescender bar 1408 may be identified by a single character representingthe bar. For example the character “F” may represent the full bar 1402,the character, “A” may represent the ascender bar 1404, the character“T” may represent the tracker bar 1406 and the character “D” mayrepresent the descender bar 1408. FIG. 14B shows an example of anintelligent barcode image 1420 along with encoded values determined bythe intelligent barcode image 1420. When the computing device 14 detectsthe type of each bar in an image, the computing device 14 may thusidentify each bar by its character so that the image may be representedas a series of the “A”, “D”, “F” and T″ characters associated with eachtype of bar in the barcode. This may be described as the ADFT sequencethat corresponds to each intelligent barcode 30. An example of the ADFTcharacter sequence 1430 for the intelligent barcode 3020 is shown inFIG. 14B. The ADFT sequence 1430 may then be used by the computingdevice 14 or some other remote processor to decode and derive numericvalues corresponding to the various fields of the intelligent barcode 30as described above with respect to FIG. 12. The numeric values for eachfield 1440 associated with the ADFT sequence 1430 are shown in FIG. 14B.The process by which a computing device 14 may decode the ADFT sequenceinto the numeric values for each of the intelligent barcode fields isfurther described in the U.S. Postal Service Specification No.USPS-B-3200 entitled Intelligent Mail Barcode (4-State Customer Barcode)(2009), which is hereby incorporated herein by reference in itsentirety.

FIG. 15 shows a flowchart of an exemplary method for retrievinginformation associated with a distribution item 8 including anintelligent barcode 30. In block 1502, the method begins when an imageof an intelligent barcode 30 affixed to a distribution item 8 isreceived and/or captured using a computing device 14 equipped with adigital camera. According to the method in FIG. 15, the computing device14 may be a smart phone with an integrated digital camera, a personalcomputer with an attached digital camera device, a laptop computer withan integrated digital camera, a tablet computer, or any other computingdevice 14 capable of capturing and processing images. Once an image ofthe intelligent barcode 30 has been received by the computing device 14,in block 1504, the computing device 14 interprets the image to generatethe ADFT character sequence determined by the intelligent barcode image.A variety of methods may be used to determine the ADFT sequence, asdescribed above and as will be further described below.

Once the ADFT character sequence corresponding to the intelligentbarcode 30 has been determined, the ADFT character sequence istransmitted to a network service in block 1506. The computing device 14may thereafter receive a response from the network service 1508. Theresponse may indicate whether a valid message was received and whetherthere is content associated with the distribution item 8. In block 1510,a computing device 14 processes the message and determines whether acontent indicator has been received. The content indicator may be, forexample, a uniform resource locator (URL) which can be used by a webbrowser on the computing device 14 to retrieve and display content. If acontent indicator was received in the response from the network service,in block 1512, the content associated with the distribution item 8 maybe displayed on the computing device 14 by using the content indicator.As described above, in another embodiment the network service mayprovide actual displayable and or usable content directly to thecomputing device 14 rather than just providing a link. The method thenconcludes at block 1520, until the computing device 14 captures and/orreceives another image of an intelligent barcode 30.

If a content indicator was not included in the response, the methodcontinues at block 1514 where the computing device 14 determines whetherthe response included an indication that the barcode was invalid. If theresponse indicates the barcode was invalid, the method proceeds to block1516 where the computing device 14 displays a message indicating thatthe barcode image received was invalid. If no content indicator wasreceived and there was no indication that the barcode was invalid, thenthe computing device 14 may determine that there was no contentassociated with the distribution item 8. In this case, as shown in block1518, the computing device 14 may display a message indicating that nocontent associated with the distribution item 8 was identified by thenetwork service.

As described in FIG. 15, a computing device 14 may interpret an image ofan intelligent barcode 30 to generate the ADFT character sequencedetermined by the intelligent barcode image. FIG. 16 shows a flowchartof an exemplary method for interpreting an intelligent barcode image todetermine the corresponding ADFT character sequence. In block 1602, theimage is thresholded into a bit matrix. In some embodiments this processmay first include the computing device 14 converting the image to a greyscale representation. In some embodiments, the bit matrix may be abinary representation of the barcode image. For example, as color (orthe shade of a color) will not matter in identifying the type of eachbar of an intelligent barcode 30, the image may choose thresholds suchthat any pixel in the image which has a determined value above a certainvalue can be considered part of a bar and represented by one value(e.g., a binary value of one), while any pixel in the image which has adetermined value below a certain value can be considered to be not partof any bar and be represented by another value (e.g., a binary value ofzero). As each pixel is processed, the computing device 14 may store theresult, a one or a zero, in a two-dimensional array of valuescorresponding to the barcode image.

In block 1604, the computing device 14 may scan/process the horizontallines of the bit matrix to locate an area of the image with the correctnumber of distinct vertical lines. Once the correct area of the imagehas been located, in block 1606, a center line for the barcoderepresented by the bit matrix is located. This center line may then beused by the computing device 14 to search the image for verticalascender and descender bars as shown in block 1608, to determine thetype of each bar identified. In one embodiment, each row of image datamay be stored such that it can be passed as an object conforming to aninterface which is used by the computing device 14 to determine whetherthe image data conforms to a barcode. The computing device 14 maydetermine a value indicating partially or fully decoded barcode data. Inthis process, the computing device 14 may be used to translate verticallines from the image data into the corresponding ADFT sequence as shownin block 1610. The process ends as shown in block 1612. In otherembodiments, the computing device 14 may use external libraries inconjunction with the blocks described in FIG. 16 or in conjunction withalternative methods used to decode and detect barcodes from an image.

In some cases, a single image captured by the computing device 14 maynot be sufficient to extract the correct ADFT sequence due to varyinglighting conditions, device movement, or in other occurrences wheregarbled images are returned. As such, it may be useful to analyze aseries of images captured in rapid succession to more accuratelydetermine an ADFT sequence of an intelligent barcode 30. For example,the computing device 14 may continuously capture images in the form of avideo stream. The computing device 14 may then continuously analyze eachimage in the stream to see if an intelligent barcode 30 has beendetected. This may increase the accuracy and the ability for thecomputing device 14 to extract the correct information from an image tobe able to accurately decode the intelligent barcode 30. For example,according to one embodiment, a successive agreement algorithm may beused to improve the accuracy of the decoding process. For example, thecomputing device 14 may determine that a valid intelligent barcode 30was identified when a minimum of three successive identicalinterpretations was detected. This may avoid false intelligent barcodedetections while a camera is being positioned or when lightingconditions vary. This may further reduce the time the computing device14 needs to process and reject garbled or incorrectly decoded images.

Once determined from the intelligent barcode image, the computing device14 may use the ADFT character sequence to determine attributesassociated with the distribution item 8 and further to be linked tocontent associated with the distribution item 8. In one embodiment, thecomputing device 14 may send the ADFT character sequences over a networkto a server 18 for further processing. FIG. 17 shows a flowchart of anexemplary method for determining content associated with a distributionitem 8 using an ADFT character sequence derived from an image of anintelligent barcode 30. According to one embodiment, the method shown inFIG. 17 may be performed by a network service on a remote server 18,such as a web service. In block 1702, the method may begin when a server18 receives an ADFT character sequence representing an intelligentbarcode 30. In block 1704, the server 18 translates the ADFT charactersequence into a thirty-one digit data sequence which corresponds to theintelligent barcode field discussed above with respect to FIG. 5. Aprocess that may be implemented by a server 18 by which the ADFTsequence may be decoded into the thirty-one digit data sequence for eachof the intelligent barcode fields is further described in the U.S.Postal Service Specification No. USPS-B-3200 entitled Intelligent MailBarcode (4-State Customer Barcode) (2009), which was incorporated hereinby reference above.

The thirty-one digit data sequence is validated in block 1706 to ensurethat each decoded data field corresponds to an acceptable value. Somevalidation may also take place when translating the ADFT sequence inblock 1704. Validation may include determining whether each numericalvalue for each intelligent barcode field is within a determined range ofvalues or may use other validation techniques, which will be appreciatedby a person/one having ordinary skill in the art. In block 1708, theserver determines whether the intelligent barcode 30 is valid. If thedecoded barcode information is invalid, a message is prepared indicatingthat the barcode was invalid in block 1712.

If the intelligent barcode 30 is valid, then in block 1710, the server18 uses the decoded data sequence to query a database for contentassociated with the barcode. The database may be local to the server ormay be at a remote location from the server. In block 1714, the server18 determines whether the query to the database returned any contentassociated with the barcode. If the query response indicated that therewas no content associated with the distribution item 8, the server 18may prepare a message indicating that no content associated with thedistribution item 8 was found at block 1718. If the query responsecontained content associated with the distribution item 8, then in block1716, a message is prepared with the content or a link to the contentreturned by the query. As described above, the database may returneither a link to content, such as a URL, or actual content that may beused by a computing device 14. The appropriate message, generated byeither blocks 1712, 1716, or 1718 is then transmitted to a computingdevice 14 in block 1720. The process ends in block 1722.

As described with reference to FIGS. 15 and 16, the computing device 14may interpret an image to generate an ADFT character sequence determinedby the intelligent barcode 30. As described above with reference to FIG.17, a server 18 may translate an ADFT sequence into a thirty-one digitdata sequence. It should be appreciated that these operations may bedone either entirely on the computing device 14, entirely by a networkservice, or any combination thereof. FIGS. 18 and 19 show examples ofembodiments where intelligent barcode image processing is performedeither on the server 18 or on the computing device 14.

FIG. 18 shows a flowchart according to an exemplary system where imageprocessing is performed by the computing device 14 used to capture theintelligent barcode image. The computing device 14 in FIG. 18 is used tocapture an image of an intelligent barcode 30 in block 1822, and theninterpret the image to generate the corresponding ADFT charactersequence in block 1824. Block 1824 may be implemented according to aprocess similar to that described with respect to FIG. 12. In block1826, the computing device 14 determines whether the ADFT charactersequence was successfully generated. If the ADFT character sequence 1804was successfully generated, then the character sequence 1804 istransmitted to a server 18 that includes a decoder web-service 1806 inblock 1830. If the ADFT character sequence 1804 was not successfullygenerated, the computing device 14 may display a message indicating suchto a user in block 1828. Otherwise, the computing device 14 waits for aresponse in block 1832. Once the response is received, then thecomputing device 14 may display the response or data associated with theresponse (e.g., the contents of a link using a web browser) on thecomputing device 14 as depicted in block 1834.

Once the ADFT character sequence 1804 is received at the server's webservice 1806, the ADFT character sequence 1804 is decoded to produce athirty-one digit sequence corresponding to the fields of the intelligentbarcode in block 1836. The server 18 with the web service 1806 may beaccessed via a wide area network 1808, such as the Internet. Using thethirty-one digit sequence, in block 1838 the web service 1806 thendetermines whether there is content associated with the intelligentbarcode field values, such as for example querying a database asdescribed above with reference to FIG. 13. In block 1840, the webservice 1806 transmits the content, if any, to the computing device 14.The content may be a content link 1810 which may be used by thecomputing device 14 to view content associated with the distributionitem 8 or may be other content. According to FIG. 18, the web servicereceives the ADFT character sequence and is not required to performimage processing of an intelligent barcode image. Avoiding imageprocessing by the web service may reduce latency if the web service isrequested to process multiple intelligent barcode 30 requests at once.This may allow for greater scalability as an increase in requests forcontent associated with a barcode will have less of an impact on latencyif image processing is performed by the computing device 14. Low networklatency may improve the user experience such that the process is usedmore frequently and different and diverse applications might be moreeasily developed for custom intelligent barcode interpreters built fordifferent devices.

FIG. 19 shows a flowchart according to an exemplary system where imageprocessing is performed by a decoder web service 1906 on a server 18,rather than by the computing device 14 used to capture the intelligentbarcode image. The computing device 14 in FIG. 19 captures an image ofan intelligent barcode 30 in block 1922 and additionally may performsome pre-processing of the image. The computing device 14 determines ifthe image captured successfully as depicted at block 1924. If the imagewas captured successfully, then the intelligent barcode image 1904 istransmitted to the server 18 in block 1928 that includes a web servicecomponent 1906. If the image was not successfully captured, thecomputing device 14 may inform the user in block 1926. The computingdevice 14 then waits for a response in block 1930. Once the response isreceived, then the computing device 14 may display the response or dataassociated with the response (e.g., contents of a link) on the computingdevice 14 as depicted in block 1932.

Once the intelligent barcode image 1904 is received at the web service1906, the image is interpreted to generate the ADFT character stringdetermined by the intelligent barcode image in block 1934. The webservice may be accessed via a wide area network 1908, such as theInternet. The web service 1906 then decodes the ADFT character string todetermine the numeric digit sequences which correspond to the datafields of the intelligent barcode 30 in block 1936. In block 1938, themethod determines whether there is content associated with theintelligent barcode field values, for example by querying a database asdescribed above. The server 18 then transmits the content, if any, tothe computing device 14 at block 1940. The content may be a content link1910 which may be used by the computing device to view contentassociated with the distribution item 8 or it may be other content.According to FIG. 19, barcode interpretation and decoding are bothpreformed by the network service. In one aspect, according to thisarchitecture, all client computing devices may reuse barcodeinterpretation as it would be performed on a server. This embodiment mayallow for a large number of client computing devices with capabilitiesof acquiring images of intelligent barcodes, to use the barcodeinterpretation functionality without having to incorporate nativebarcode interpretation libraries for each client device. On the otherhand, this architecture may increase latency as multiple requests tointerpret barcode images may have to be processed by the network, ratherthan done individually by each requesting client computing device.

It should be appreciated that the network architectures shown in FIGS.18 and 19 describe just two examples of the division of responsibilityfor performing the operations necessary for decoding an image of anintelligent barcode 30 and retrieving content associated therewith andother embodiments are possible. For example, the computing device 14 maybe configured to decode the ADFT character sequence 1404 to determinethe numerical values corresponding to the barcode fields and then beconfigured to transmit these fields to a network service. In this way,only a portion of the fields associated with the intelligent barcode 30may need to be transmitted if only a portion of those fields are used todetermine whether content exists for the intelligent barcode 30.Additionally, further validation may be able to occur on the computingdevice 14 that may improve scalability of the system where lessprocessing is required by the network service.

FIGS. 20A-20C show examples of exemplary user interfaces that may beused in conjunction with the methods described with respect to FIG.1-19, FIG. 20A shows an example of a user interface that may be used toaid in capturing an intelligent barcode image using a computing device14 such as a smart phone with an integrated digital camera (not shown).The computing device 14 may included a display 2006 which continuouslydisplays the output of the digital camera. The continuous video streamof camera output on the display 2006 allows a user to identify andpreview an intelligent barcode 30 for acquiring the image. Additionally,the display 2006 may also show an overlay frame 2008 which defines anarea of the camera output viewed on the display for framing anintelligent barcode 30. The overlay frame 2008 is continuously displayedso that a user may move the computing device 14 such that an intelligentbarcode 30 may be framed within the overlay frame 2008 before thecomputing device 14 captures the intelligent barcode image. By using theoverlay frame 2008, the computing device 14 may more easily identify theportion of the image including the intelligent barcode 30 and may allowfor easier processing of the intelligent barcode for determining theADFT character sequence. For example a skewed, or mis-orientated imagemay make it more difficult for the computing device 14 to identify thehorizontal bars. The overlay frame 2008 will help to improve theaccuracy and ability to capture an intelligent barcode 30. The overlayframe 2008 is not included in the captured image.

FIG. 20B shows an example of a user interface for a computing device 14that may be displayed when a barcode is successfully decoded and aresponse is received from a server 18. This display 2006 may show thecaptured image of the intelligent barcode 30 along with a message 2010indicating that the barcode was successfully decoded. The message 2010may also provide a user-selectable option to view content associatedwith the barcode. For example, the message may query a user as towhether the user wishes to view further information. The user selectableoption may cause the computing device 14 to display a web browser thatis redirected to a link retrieved from the network service.

FIG. 20C shows an example of a user interface for a computing device 14that may be displayed when the barcode is unsuccessfully decoded byeither the computing device or the network service. The display 2006 mayshow a message 2012 indicating that the barcode was decodedunsuccessfully and may query the user as to whether they would like totry to acquire another image of the intelligent barcode. This message2012 may be displayed corresponding to a variety of scenarios. Forexample, the network service may respond with a message indicating thebarcode was invalid. Or the message 2012 may be displayed if thecomputing device failed to process the image correctly or failed to beable to determine the ADFT character sequence from the image. Othererror messages may also be displayed to notify the user, for example,that there was no content associated with a valid barcode, or morespecific details for any reason why the barcode was unsuccessfullydecoded.

Picture Permits and Postage

In some embodiments, an information item can include a picture permit. Apicture permit can be located at any position on a distribution item,and can have any desired size. A picture permit can be used as postage,or in addition to postage. FIG. 21A depicts one embodiment of adistribution item 2100 with an affixed picture permit 2110. The picturepermit 2110 contains a first text portion 2112, an image portion 2114,and a second text portion 2116. In some embodiments, a picture permit2110 can be associated with additional information at a server orcomputing device. In some embodiments, a picture permit 2110 can beassociated with addition information by the image portion 2114. In someembodiments, a picture permit 2110 can be associated with additionalinformation by one or both of the first text portion 2112 and the secondtext portion 2116. In some embodiments, the picture permit 2110 can beassociated with additional information by the image portion and one orboth of the first text portion 2112 and the second text portion 2116. Insome embodiments, the picture permit 2110, in connection with one ormore other information items on the distribution item can be associatedwith additional information.

In some embodiments, the text portion of a picture permit can be anencoded text string. In some embodiments, the encoded text string cancomprise alpha-numeric characters. In some embodiments, the text stringcan comprise words. These words can provide information relating to themail piece, such as, for example, the postage status, class, deliveryservice, handling instructions, an internet address, an e-mail address,sender information, company information, or any other information. Apicture permit can include an image. As depicted in FIG. 21A, the firsttext portion 2112 describes the postage status and the mail class forthe mail piece. As also depicted in FIG. 21A, the second text portion2116 provides company name and permit number. A permit number can beassociated with a permit account associate with delivery services,handling instructions, billing or payment information, or any otherinformation.

The image portion 2114 can include an image. The image can be a colorimage, a black-and-white image, a grayscale image, or any other type ofimage. In some embodiments, the image can be of an object or itemrecognizable to the recipient of the mail piece. In some embodiments,the image may be non-recognizable to the recipient of the mail piece. Animage can be created using a variety of techniques. In some embodiments,an image can be embedded in a computer readable code, such as, forexample, a barcode, or a quick response code (“QR code”). In someembodiments, a computer readable code, such as, for example, a barcodeor a QR code can be embedded in an image. In some embodiments, aspectsof the image can comprise the computer readable code. These can include,for example, image shape, image dimensions, image color, image bordershape, or any other image characteristic.

An image can be created through a variety of techniques, includingprinting, embossing, impregnating, or any other technique. In someembodiments, an image can be created using ink with detectablecharacteristics. In one embodiment, a portion of the image may includemagnetic ink, fluorescent ink, infrared ink, ultraviolet ink,radioactive ink, or other detectable ink. In one embodiment, a portionof the image may include an embedded electronic device, such as, forexample, a radio-frequency identification (RFID) device.

An image portion 2114 can include any desired image. In someembodiments, an image can depict the subject of additional informationwith which the picture permit is associated. Alternatively, an image candepict something with no apparent association to the subject of theadditional information. In some embodiments, the image can be of or asymbol of a product or service. In one embodiment, for example, an imagecan identify a specific good or service, such as an image of a specificmake and model of, for example, an automobile. In one embodiment, animage can designate a line or class of goods or services, such as, forexample, an image depicting a washing machine representing all washingmachines made by a manufacturer. In one embodiment, an image can beassociated with the general topic of the additional subject matter ofthe additional information with which the image is associated. FIG. 21 adepicts an embodiment of a black-and-white image of a recipientrecognizable item, namely, an automobile. The image itself, or somethingwithin the image, may allow for specifically or uniquely identifying thedistribution item. For example, the image may have a marking in aparticular location that provides a feature allowing for uniqueidentification.

In one embodiment, the second text portion 2116, including informationrelating to the permit number and sender and the image portion 2114 canbe associated with additional information. Advantageously, use ofinformation from the text portion in connection with information fromthe image portion can simplify the image recognition process.

A picture permit can be of a defined size and shape. In some embodimentsone or more of an image portion or a text portion can have a definedsize or shape. FIG. 21B depicts one embodiment of a picture permit 2110.As depicted in FIG. 21B, picture permit 2110 is defined by a firstdimension 2130 and a second dimension 2132. First dimension 2130describes the height of picture permit 2110 and second dimension 2132describes the width of picture permit 2110. The height and width of thepicture permit can comprise a variety of dimensions. In embodiments inwhich a picture permit is configured for use in connection with adistribution item that is a mail piece, the picture permit can be sizedand shaped to fit on the mail piece. In some embodiments, for example, apicture permit can have a first dimension 2130 less than three inches,less than two inches, or less than one inch and a second dimension 2132less than three inches, less than two inches, or less than one inch. Inone embodiment, the first dimension 2130 is between approximately 1.75and 1.5 inches and the second dimension can be between approximately 1.5and 1.31 inches.

As depicted in FIG. 21B, the dimensions of the picture permit can bedifferent from the dimensions of the different portions 2112, 2114, 2116of the picture permit 2110. In one embodiments, image portion 2114 canbe defined by a first dimension 2134 and a second dimension 2136. Firstdimension 2134 of the image portion 2114 describes the height of theimage portion and second dimension 2136 describes the width of the imageportion. In one embodiment, the first dimension 2134 of the imageportion 2114 can be less than three inches, less than two inches, orless than one inch, and the second dimension 2136 of the image portion2110 can be less than three inches, less than two inches, or less thanone inch. In one embodiment, the first dimension 2134 of the imageportion 2110 is between 0.84 and 1.0 inches and the second dimension2136 of the image portion 2110 is between 1.31 and 1.5 inches.

In some embodiments, the first dimension 2134 or the second dimension2136 of the image portion 2114 can coincide with the first dimension2130 and the second dimension 2132 of the picture permit 2110. In someembodiments, the first dimension 2134 and the second dimension 2136 ofthe image portion do not coincide with the first dimension 2130 and thesecond dimension 2132 of the picture permit 2110.

Text portions 2112, 2116 can include text of varying fonts, colors, andsizes. In one embodiment, text portions can include text larger than 4point, 6 point, 8 point, 10 point, 12 point, 20 point, or any othersize. In one embodiment, text in text portions 2112, 2116 can be 8 pointor larger.

Text portions can be defined by a height and a width. In one embodiment,the width of text portions 2112, 2116 can be less than or equal to thesecond dimension 2136 of the image portion 2114. In one embodiment, thewidth of text portions 2112, 2116 can be greater than or equal to thesecond dimension 2136 of the image portion 2114. In one embodiment, thewidth of text portions 2112, 2116 can be less than or equal to 1.31inches.

Text portions 2112, 2116 can be separated from image portion 2114 by adistance. The distance of separation between the text portions 2112,2116 and the image portion 2114 can vary. In one embodiment, the minimumseparation between each of the text portions 2112, 2116 and the imageportion can be at least 0.05 inches, 0.1 inches, 0.25 inches, 0.5inches, or any other distance.

A picture permit 2110 can be located at any position on a distributionitem 2100. In some embodiments in which a picture permit 2110 is used inconnection with a mail piece, the picture permit may be located in thepostage position. FIG. 21C depicts a distribution item 2100 with apicture permit 2110 located in the postage position. In someembodiments, the picture permit can be specifically located relative tothe sides of the distribution item 2100. As depicted in FIG. 21C, thepicture permit 2110 is spaced a distance 2140 from the edges of thedistribution item 2100. Distance 2140 can vary. In some embodiments,distance 2140 can be, for example, less than three inches, less than oneinch, less than one-half inch, less than one-quarter inch, or any otherdistance. In one embodiment, distance 2140 can be approximately 0.25inches.

In some embodiments, and as depicted in FIG. 21C, a picture permit 2110can be positioned so as to be separated from other portions of thedistribution item 2100 by a first distance 2142 and a second distance2144. First distance 2142 can be the same or different than seconddistance 2144. In some embodiments, first distance 2142 can be greaterthan 0.1 inches, greater than 0.25 inches, greater than 0.5 inches,greater than 1 inch, greater than two inches, or any other distance, andsecond distance 2144 can be greater than 0.1 inches, greater than 0.25inches, greater than 0.5 inches, greater than 1 inch, greater than twoinches, or any other distance. In some embodiments, first distance 2142and second distance 2144 are greater than or equal to 0.5 inches.

Some embodiments of a distribution item content retrieval system provideassociation of a distribution item with additional information throughthe use of a standard stamp or custom postage. FIG. 22A depicts oneembodiment of a standard stamp 2202 on a distribution item 2200 and FIG.22B depicts one embodiment of a custom postage 2210 on a distributionitem 2200.

A standard stamp 2202 can be used as one of several sources ofinformation on a distribution item for associating the distribution itemwith additional information. In one embodiment, a distributer mayprovide one or more information items on a distribution item. One ofthese information items can be a standard stamp 2202. A distributer mayuse a designated one of the standard stamps 2202 as an additionalinformation item. In such an embodiment, the standard stamp 2202, inaddition to other information items could be evaluated to identifyadditional information associated with the distribution item.

Custom postage can be used as one of several sources of information on adistribution item for association the distribution item with additionalinformation. As depicted in FIG. 22B, custom postage 2210 (e.g., PostagePC) can comprise a code portion 2212 and an image portion 2214. The codeportion 2212 can comprise any form of computer readable encoding,including text, a barcode, a QR code, or any other encoding. An imageportion 2214 of custom postage 2210 can comprise an image integratedinto a computer readable code, a computer readable code encoded into theimage, or an identifiable image. In some embodiments, the image portion2214 of the custom postage 2210 can be used in connection with otherinformation items on a distribution item to identify additionalinformation. In some embodiments, the code portion 2212 of the custompostage 2210 can be used in connection with other information items on adistribution item to identify additional information. In someembodiments, both the image portion 2214 and the code portion 2212 of acustom postage 2210 can be used, alone, or in connection with otherinformation items of a distribution item to identify additionalinformation.

FIGS. 23-24 show flowcharts depicting an exemplary method for use of aprinted permit 2110, standard stamp 2202, or custom postage 2210 forretrieving information associated with a distribution item. FIG. 23shows a flowchart of an exemplary method for retrieving informationassociated with a distribution item including one of a printed permit2110, a standard stamp 2202, or a custom postage 2210. In block 2302,the method begins when an image of a printed permit 2110, standard stamp2202, or custom postage 2210 affixed to a distribution item is receivedand/or captured using a computing device equipped with a digital camera.According to the method in FIG. 23, the computing device may be a smartphone with an integrated digital camera, a personal computer with anattached digital camera device, a laptop computer with an integrateddigital camera, a tablet computer, or any other computing device capableof capturing and processing images. Once an image of the printed permit2110, standard stamp 2202, or custom postage 2210 has been received bythe computing device, in block 2304, the computing device interprets theimage to generate a code sequence determined by the image of the printedpermit 2110, standard stamp 2202, or custom postage 2210. A variety ofmethods may be used to determine the code sequence, as described aboveand as will be further described below.

Once the code sequence corresponding to the printed permit 2110,standard stamp 2202, or custom postage 2210 has been determined, thecode sequence is transmitted to a network service in block 2306. Thecomputing device may thereafter receive a response from the networkservice 2308. The response may indicate whether a valid message wasreceived and whether there is content associated with the mail piece. Inblock 2310, a computing device processes the message and determineswhether a content indicator has been received. The content indicator maybe, for example, a uniform resource locator (URL) which can be used by aweb browser on the computing device to retrieve and display content. Ifa content indicator was received in the response from the networkservice, in block 2312, the content associated with the mail piece maybe communicated to the user by computing device. In some embodiments,the content associated with the mail piece may be displayed on thecomputing device by using the content indicator. As described above, inanother embodiment the network service may provide actual displayable,communicable, and or usable content directly to the computing devicerather than just providing a link. The method then concludes at block2320, until the computing device captures and/or receives another imageof a printed permit 2110, standard stamp 2202, or custom postage 2210.It should be appreciated that a printed permit 2110, standard stamp2202, or custom postage 2210 may be used to associate a distributionitem 8 with digital educational, entertainment, promotional andmarketing material that may be provided to a recipient 12 via acomputing device 14. Furthermore, at least a portion of a printed permit2110, standard stamp 2202, or custom postage 2210 may be may bemanipulated and superimposed on other pictures, images and materials toproduce new digital impressions. Furthermore, stamps, custom postage, orpicture permits, etc, may be manipulated or superimposed via an APIs andother applications to enable customers to reach their target audiencedigitally with expanded offerings and services.

If a content indicator was not included in the response, the methodcontinues at block 2314 where the computing device determines whetherthe response included an indication that the image of the printed permit2110, standard stamp 2202, or custom postage 2210 was invalid. If theresponse indicates the image of the printed permit 2110, standard stamp2202, or custom postage 2210 was invalid, the method proceeds to block2316 where the computing device displays a message indicating that theimage received of the printed permit 2110, standard stamp 2202, orcustom postage 2210 was invalid. If no content indicator was receivedand there was no indication that the image of the printed permit 2110,standard stamp 2202, or custom postage 2210 was invalid, then thecomputing device may determine that there was no content associated withthe distribution item. In this case, as shown in block 2318, thecomputing device may display a message indicating that no contentassociated with the distribution item was identified by the networkservice.

As described in FIG. 23, a computing device may interpret an image of aprinted permit 2110, standard stamp 2202, or custom postage 2210 togenerate the code sequence determined by the printed permit 2110,standard stamp 2202, or custom postage 2210 image. FIG. 24 shows aflowchart of an exemplary method for interpreting a printed permit 2110,standard stamp 2202, or custom postage 2210 image to determine thecorresponding code sequence. In block 2402, the distribution item isscanned to determine if it includes an information item, such as aprinted permit 2110, standard stamp 2202, or custom postage 2210. If thedistribution item does not include a printed permit 2110, standard stamp2202, or custom postage 2210, the process goes to block 2412. If thedistribution item includes an information item such as a printed permit2110, standard stamp 2202, or custom postage 2210, the process moves toblock 2404 where the printed permit 2110, standard stamp 2202, or custompostage 2210 is scanned and the type of the information item isdetermined.

The image may be broken into components as the computing devicedetermines, in block 2406, if the printed permit 2110, standard stamp2202, or custom postage 2210 includes computer readable code, text, andor an image. If the information item such as a printed permit 2110,standard stamp 2202, or custom postage 2210, does not include computerreadable code, text, and or an image, then the process moves to block2412. If the computing device determines that the information item suchas a printed permit 2110, standard stamp 2202, or custom postage 2210,does include computer readable code, text, and or an image, thecomputing device scans each of the computer readable code, text, and oran image in the information item at block 2408.

The computing device then proceeds to translate the scanned images intoa code sequence in block 2410. This process can use Optical CharacterRecognition (“OCR”) software, code scanning software, or imagerecognition software. This code can then be used, alone or in connectionwith other code taken from the distribution item, to determine anddeliver data or information associated with the distribution item. Insome embodiments, specifications may direct a specified placement of theprinted permit 2110, standard stamp 2202, or custom postage 2210 on adistribution item 8. This may be used by image recognition systems,software, and/or devices to accurately detect the location of imagesand/or textual information and further aid in the ability to process andderive information from the scanned images. Image recognition mayinclude using other information extracted from the distribution item tonarrow the possible images need to be recognized. Image recognitionssoftware may further identify specific areas of an image that allow forunique identification and to perform additional processes as will beknown in the art. For example, image recognition software and hardwaremay perform functions some as object segmentation, object recognition,facial recognition, color segmentation, orientation, image matching, andthe like. In some embodiments, deriving information about a distributionitem 8 from an image may include performing image recognition on theimage to determine what is depicted in the image. For example, the imagein a stamp, picture permit, or custom postage may be a product offeredby a mailer that may be detected using image recognition software on aserver or computing device. In one embodiment, the image recognition mayinclude comparing the image against possible matches to determine theimage. Determining the specific image may allow for identifying thedistribution item 8 and/or content associated with the distribution item8 that may be experienced via a computing device 14.

FIGS. 25A-25C show examples of exemplary user interfaces that may beused in conjunction with the methods described with respect to FIGS.21-24. FIG. 25A shows an example of a user interface that may be used toaid in capturing an image of a printed permit 2110, standard stamp 2202,or custom postage 2210 using a computing device 14 such as a smart phonewith an integrated digital camera (not shown). The computing device 14may included a display 2506 which continuously displays the output ofthe digital camera. The continuous stream of camera output on thedisplay 2506 allows a user to identify and preview information items 10for acquiring the image. Additionally, the display 2506 may also showone or more overlay frames 2508 which defines an area of the cameraoutput viewed on the display for framing information items 10. Theoverlay frame 2508 is continuously displayed so that a user may move thecomputing device 14 such that the information items 10 may be framedwithin the overlay frames 2508 before the computing device 14 capturesthe information item data. By using the overlay frame 2508, thecomputing device 14 may more easily identify the portion of the imageincluding the information items 10 and may allow for easier processingof the information items. The overlay frame 2508 can improve theaccuracy and ability to capture information items 10. The overlay frame2508 is not included in the captured image.

FIG. 25B shows an example of a user interface for a computing device 14that may be displayed when an information item is successfully decodedand a response is received from a server 18. This display 2506 may showthe captured image of the information item 10 along with a message 2510indicating that the information item was successfully decoded. Themessage 2510 may also provide a user-selectable option to view contentassociated with the information item. For example, the message may querya user as to whether the user wishes to view further information. Theuser selectable option may cause the computing device 14 to display aweb browser that is redirected to a link retrieved from the networkservice.

FIG. 25C shows an example of a user interface for a computing device 14that may be displayed when the information item is unsuccessfullydecoded by either the computing device or the network service. Thedisplay 2506 may show a message 2512 indicating that the informationitem was decoded unsuccessfully and may query the user as to whetherthey would like to try to acquire another image of the information item.This message 2512 may be displayed corresponding to a variety ofscenarios. For example, the network service may respond with a messageindicating the barcode was invalid. Or the message 2512 may be displayedif the computing device failed to process the image correctly or failedto be able to determine the code sequence from the image. Other errormessages may also be displayed to notify the user, for example, thatthere was no content associated with a valid information item, or morespecific details for any reason why the information item wasunsuccessfully decoded.

It should be appreciated that the figures described above may use asingle piece of information (such as a barcode, image, etc) or may use acombination of information items 10. For example, an image may becaptured of a distribution item that includes both a picture permit 2110and an intelligent barcode 30 as described above. This information maybe processed and data derived from both the intelligent barcode 30 andthe picture permit 2110 and combined to further identify a distributionitem and provide information that will allow customization and/orselection of content to be provided. As such, any combination of theabove systems and method is contemplated for delivering content to arecipient via a computing device 14 that is able to electronicallyprocess information items 10 associated with the distribution item.

Content, Services and Offerings Associated with a Distribution Item

As described above with reference to FIGS. 1-20, various embodimentsprovide for delivering content associated with a distribution item 8 toa computing device 14 using an information item 10 delivered with thedistribution item 8. In this way, customized and/or interactive contentmay be provided to a recipient 12. In one sense, this allows adistribution item 8 to be accompanied by computer-generated augmentedreality content that is associated with the content of the distributionitem 8. For example, a 2D image printed on a distribution item 8 may beused and processed by a computing device 14 to link to virtual andinteractive content associated with an item represented in the 2D image.

In one embodiment, the distribution item 8 may include printed media ora postcard depicting a product. The information item 10 described abovemay be an image of a product that is printed on the distribution item 8.For example, an image of a vehicle may appear on an envelope of adistribution item 8 sent from a company seeking to advertise a newvehicle. The computing device 14 may be used by the recipient 12 tocapture an image of the vehicle. The computing device 14 may then beable to send the captured image of the vehicle, after performing anyadditional processing as necessary, for efficient transmission, to aserver 18. The server 18 may be operated by the distribution serviceprovider, such as, for example, by the U.S. Postal Service. As describedabove, the server may perform image recognition on the image todetermine the type of vehicle. Additional information items 10 processedby the computing device 14 may be used in conjunction with the image ofthe vehicle to more easily determine a specific type of vehiclerepresented by the image.

Based on the image, the server 18 may be able to associate the image ofthe vehicle with further content with respect to the vehicle that may bedelivered to the computing device 14 and provided for experiencing bythe recipient via the computing device 14. For example, using datareceived from the server 18 (via either a link or actual content) anapplication (either a native application or via a web browserapplication) on the computing device 14 may be configured to displaydifferent perspective views of the vehicle along with furtherinformation. In addition, an application on the computing device 14 maybe configured to let a recipient 12 virtually “test drive” the vehicleafter the recipient 12 uses the computing device 14 to process the imageof the vehicle. In some embodiments, as described above, the mailer mayoperate a server which may receive processed data relating to theinformation item 10. The mailer's server may generate the content fordelivery to the computing device either directly or via the server 18that may be operated by the distribution service provider. As can beappreciated, there is a wide variety of other types of interactivecontent that may be desirable to be provided via a computing device 14in association with content sent with a distribution item 10.

In another embodiment, the content delivered via the computing device 14may include a customized animation associated with the product, or avideo with further information or advertising with respect to theproduct. For example 2D or 3D video presentations may be delivered.Furthermore, the content may allow virtual or actual interaction with aprototype or model of a product. Content may include visual, narrated,and media-rich content.

As such, in one aspect, an image on a picture permit or stamp used formailing purposes (e.g., payment and routing) may further be takenadvantage of to link a recipient 12 to expanded content associated withthe image and the distribution item 8. This may further allow a mailer 2in flexibility in providing a distribution item 8 that is able toattract recipients 12 and provide them with additional interactiveservice offerings and content.

In other embodiments, the content delivered via the computing device 14may be a catalog detailing information about the product and otherproducts that may give more price details, other views, and additionalinformation. In addition, the content may include coupons associatedwith the product represented on a distribution item when thedistribution item is scanned by the computing device 14. In otherembodiments, the content may provide the computing device with theability to display an online product offering that allows purchasing theproduct directly from the computing device 14, such as an e-commercewebsite. In this case, if a recipient chooses to place an order for aproduct in response to viewing content after processing the informationitem 10 on the distribution item 8, the distribution service providerused to facilitate this process, such as the U.S. Postal Service, may beautomatically selected as the shipper of that product. As such, thedistribution service provider would be able to benefit from providingservices for allowing a recipient to process and associate content witha distribution item 8.

In another embodiment, additional data may be sent by the computingdevice 14 in addition to the data derived from the information item 10to deliver customized content to the recipient 12. For example, thecomputing device 14 may also transmit its geographic location, date/timeinformation, object proximity, other actions performed by a recipient12, and the like. For example, geo-location information provided by acomputing device 14 (or alternatively by an intelligent barcode 30field) may be used to gather data and provide localized services orofferings. For example, an advertiser may send a distribution item 8 outto a large geographical area. When a recipient 12 uses a computingdevice 14 to derive data from the information item 10, the computingdevice may be linked to content or offerings specific to the location inwhich the distribution item 8 was processed using the computing device14. In another example, an increased discount might be made availablethrough the intelligent barcode 30 for recipients in a certain zip codeor series of zip codes defining a geographic location. This data mayalso be used to better track recipients based on their preferences andchoices when they use a computing device 14 to decode the barcode.

In other embodiment, content can be provided based on the proximity ofthe recipient to the delivery address of the recipient based on thecurrent geographical location provided by the computing device 14. Forexample, a distribution item 8 may include an advertisement for aproduct that may be purchased at some retail location. When a recipient12 uses a computing device 14 to access content associated with theproduct depicted in the distribution item 8 as described above, thecontent generated and sent to the recipient's 12 computing device 14 maybe determined by the geographical location and the recipient's 12address to which the distribution item was delivered. If thegeographical location of the computing device is closer to the retaillocation than the address of the recipient, then the content sent to thecomputing device 14 may be a coupon. However, if the geographicallocation of the computing device 14 is closer in proximity to theaddress for the recipient, then the content provided via the computingdevice 14 may include a catalog, video, or other offering detailinginformation about a variety of products. In another embodiment, a couponfor a local retail location may be provided rather than a nationallybased advertisement based on the geographical location of the computingdevice 14. Further customization of content based on the geographicallocation is also possible and contemplated herein. Other data, includingdate/time information, and other actions performed by a recipient 12 onthe computing device 14 may also be used to provide targeted/customizedcontent to the computing device 14.

According to various embodiments described above and contemplatedherein, a third party, such as a mailer, may operate a network servicethat is configured to provide customized content that may be experiencedvia a computing device 14. The third party may enter into an agreement(e.g., sign up) for a service provided by the distribution serviceprovider (e.g., the U.S. Postal Service) which provides the systemsnecessary for allowing a recipient to be linked to content associatedwith a distribution item 8. The service may allow a network service (orother service) to receive information when a distribution serviceprovider service receives information in response to a recipient 12using a computing device 14 to process the distribution item 8 to belinked to further content. For example, the distribution item 8 may besent from the third party who receives data at a network service fromthe distribution service provider's service in response to the recipient12 using the computing device 14 to access additional content asdescribed above. Once the information is received, the third partyservice may generate customized content and either provide the contentdirectly to the computing device 14 or via the distribution serviceprovider service. As such, a wide range of partnerships and combinationsof systems and services may exist between mailers and the distributionservice provider to allow providing expanded offerings and userexperiences to a recipient 12 of a distribution item 8.

In another embodiment, the system described in the figures above mayprovide additional interactivity associated with receiving adistribution item 8. For example, a distribution service provider mayprovide for a service that allows a user to provide personalized contentthat may be affixed or printed on a distribution item. For example, amailer may wish to send an invitation to a birthday party and may beable to upload a custom picture from a digital camera or other drawingsor personally chosen illustration to be printed on a mail piece. In somecases, the personalized item may be used as postage. The mailer wouldthen be able to print or have printed the distribution item 8 formailing to a select group of recipients. The mailer may also provideadditional content, such as a media file that provides a personalizedaudio message to a service operated by the distribution serviceprovider. The service of the distribution service provider wouldassociate the uploaded image affixed to potential distribution itemswith the additional content.

After being sent, a recipient of the birthday invitation would be ableto use a computing device 14 to electronically capture information aboutthe personalized image sent with the invitation and provide the image orinformation derived from the image to a network service of thedistribution provider as described in the figures above. The networkservice provider may then use the information or image to identify thedistribution item 8 and associate the distribution item with content themailer uploaded. This content may then be provided to the computingdevice 14 to be experienced by the recipient 12 using the computingdevice 14. For example, the computing device 14 may play the media fileoriginally provided by the mailer. For example, a birthday card with apersonalized image printed on the card could be used to link thecomputing device 14 to a media file that plays a “Happy Birthday” song.In another embodiment, a sender of the birthday card may be able torecord and store a personalized greeting in a media file. The media filemay be provided to a server and associated with an image affixed to thebirthday card. As such, when a computing device 14 is used to processinformation on the distribution item 8, the computing device 14 may beable to access and play the personalized greeting. It should beappreciated that a wide variety of other invitations, greetings, andother such customized mailings could be provided by a mailer along withcustomized content that may be associated with the distribution item 8and accessed by the recipient 12 upon receipt via a computing device 14.

In another embodiment, a distribution item 8 could include an invitationto an event, such as, for example, a wedding. When a recipient 12 uses acomputing device 14 to decode an information item 10, the computingdevice 14 may prompt the user to add the event to an electroniccalendar/reminder application. Further, the computing device may be ableto link a recipient 12 to an electronic service or website associatedwith the event such as a website allowing a recipient 12 to RSVP, or toa gift registry web site.

In another embodiment, the system described in the figures above mayfacilitate and/or add interactivity to a coupon offering. For example, aservice provider may send a distribution item 8 with an affixedinformation item 10 with a coupon that indicates a restriction on thetotal number of recipients that may redeem the coupon. In one case, toredeem the offer, a recipient 12 may use a computing device 14 to decodean information item 10, such as a barcode, on the coupon. The computingdevice 14 may then be linked to content that allows the recipient 12 topay for the item advertised if the number of recipients that haveredeemed the coupon is still within the amount allowed. Furthermore, thecomputing device 14 may display the remaining amount of couponredemptions available. In another embodiment, the distribution item 8including the coupon may be taken to a vendor and redeemed for someproduct or service. The information item 10 may be processed and/ordecoded by the vendor in order to track the total amount of coupons usedand to limit the coupon offering. Furthermore, before taking the couponto a vendor to redeem the coupon, the recipient 12 may use a computingdevice 14 to process and/or decode the information item 10, so that thecomputing device 14 is linked to content that displays whether or notthe coupon is still valid.

In another embodiment, the computing device 14 and information item 10may be used to provider a recipient 12 with other unique productofferings that provide for a socialization concept. For example, amailer may wish to make an offer for a product at a discount but only ifenough people take advantage of such an offer. As one example, a cardealership may provide a discount price on an incoming shipment of newcars if 100 people in a geographic area are willing to make thepurchase. According to the development, the mailer may send the offeringin the mail to a geographic area indicating that the offer is valid ifenough people within the area are willing to accept the offer. Arecipient 12 in the defined area may use a computing device 14 toprocess and/or decode an information item 10 and be linked toinformation indicating how many people have currently expressed theirwillingness to accept the offer as a group as well as an option toaccept or decline the offer. The information item 10 may be processedand/or decoded by the computing device 14 at a later time to checkwhether enough people have accepted the offer to make the offereffective. In this way, a sender can target and coordinate a groupdiscount by sending the offer as a distribution item 8 with aninformation item 10.

In another embodiment, the systems described in the figures above mayallow a computing device 14 to be used as a replacement of a physicaldistribution item 8 currently in route. For example, if a person loses aconcert ticket, they may request a replacement ticket to be sent in themail. However, the concert date may be sooner than the time needed tosend the replacement ticket in the mail. In this case, a person may beallowed to obtain an image of an information item 10, such as an encodedvalue, that is being sent with the concert ticket. This may then be usedto print the encoded value and be decoded at the concert venue to verifythat the person has a valid ticket in the mail. In another embodiment, arecipient 12 of a concert ticket in the mail may use a computing device14 to decode an encoded value affixed to the ticket. This may allow arecipient 12 to later store and/or access an image of the ticket (orencoded barcode affixed to the original ticket) at any time in case theoriginal ticket is lost.

In another embodiment, a mailer may not wish to provide certain personalinformation, or may wish to conserve the amount of information, providedin a delivery item. For example, a mailer may send out phone bills to arecipient who has signed up for telephony services. The mailer may notwish to provide certain sensitive information about the identities ofpersons called, and other such information. Furthermore, the mailer maywish to conserve paper by limiting the amount of information sent withthe bill in a distribution item. As such, the mailer may provide aninformation item 10 that may be used by a computing device 14 to beprovided further information with respect to the bill. For example, abarcode or image may be affixed to the bill sent inside an envelope thatmay be decoded and or processed by a computing device 14.

Using the systems and services according to the description and figuresdescribed above, the computing device 14 may be provided withinformation about the bill in response to processing the bill with thecomputing device 14. The computing device and associated systems mayfurther provide authorization services to authenticate that therecipient 12 is authorized to access the information. In addition toproviding password protection and authentication services, the systemsmay use the geographic location of computing device 14 to determine theproximity of the person using the computing device to the address wherethe bill was delivered. If there is an anomaly, then access might berestricted. Furthermore, if the time the bill is processed using thecomputing device 14 is too far removed from the time the bill was sentto the recipient, then access may also be restricted. One skilled in theart can appreciate the variety of authorization that may be provided.Once authorized, the content via the computing device 14 may providefurther information with respect to the bill such as personalinformation, further billing data, other sensitive information, and thelike. Furthermore, the computing device 14 may provide an interface forsending an electronic payment or other automated payment options withrespect to the bill in response to electronically processing informationon the bill.

The systems and services according to the description and figuresdescribed above may therefore be used to verify the location of a user,for protecting, for example, against identify theft. For example, a usermay sign up, via an online application, for a service and may submit anaddress along with other identifying information. The service providerproviding the service may physically mail a distribution item 10 such asa mail piece to the address provided affixed with a barcode or otherinformation described above. The user may then process the informationaffixed to the distribution item as described above. In response,geographic location information provided via the computer device 14 maybe sent to verify the user's location in proximity to the addressprovided. This may allow to the service provider to verify the user andprotect against identify theft or like scenarios.

In addition to the types of content/offerings described above, thedevelopment provided by the system in the figures above furthercontemplates other offerings, interactive services, tracking services,or the like.

Applications, User Interfaces, and User Preferences

Much of the functionality described above that may be performed on thecomputing device 14 may be provided via an application or set ofapplication provided by the computing device 14. In this way, thecomputing device 14 may perform other functions and existing computingdevices 14 may be enabled to perform the processing of information items14 on distribution items 8 as described above. For example, thecomputing device 14 may be a smartphone. An application may be providedby the distribution service provider that may be downloaded or installedon the smartphone and be used for processing an information item 10 (orcombination of information items) and communicating with a server 18operated or configured by the distribution service provider. Theapplication may comprise of a set of applications. Furthermore, thirdparty applications may also be used that may make use of, for example,an application programming interface (API), to communicate with theservers 18 operated or configured by the distribution service providerto provide the functionality described above. Third party applicationsmay need permission from the distribution service provider, providingthe systems, to actually deliver content to a computing device using thesystems and methods described herein. It should be noted that theoperator of the third party application may need to have an agreement(such as a license, etc.) with the distribution service provider to beable to access information. It should be appreciated that theapplication(s) may be native applications that run on the computingdevice or may be non-native applications, such as web applications, thatmay be accessed via a web browser or similar functionality.

An application may provide the user with the ability to configurepreferences with the types of information sent to an external server andwith respect to the types of content received. More specifically, anapplication may allow the user select the types of information that willbe sent to the server 18 by the computing device 14. For example, a usermay not wish to have geographic location information sent to a server18, or may wish other personal information that could be sent to furthercustomized services or offerings not to be sent to a server 18. Further,an application may provide user preferences for which type of targetedcontent may be delivered to a computing device. For example, a user maybe able to select a preference such that only coupons are returned, orthat coupons are preferred over other advertisement content.Alternatively, a selectable preference may provide that no coupons areto be received and only other targeted offerings. One skilled in the artmay appreciate the variety of different types of preferences that may beconfigured and set-up by the user to select the type of content that maybe provided by the systems described above. Furthermore, userpreferences may be configured per mailer such that each mailer may haveset of preferences for content delivered or the type of information thatmay be sent by the computing device. Further information regarding userpreferences per mailer may be found in U.S. patent application Ser. No.13/179,442 entitled SYSTEM AND METHOD OF ELECTRONIC AND PHYSICAL MAILCATEGORIZATION AND TARGETED DELIVERY, which is hereby incorporated byreference in its entirety.

The applications may provide a variety of user interfaces for displayingand providing content to a recipient 12. The applications may be able toprovide haptic feedback and may provide a variety of audio visualcapabilities as necessary or determined by the content associated withthe distribution item 8.

Furthermore, applications and user interfaces may be provided to allowusers to upload content and to associate uploaded content with mail sentto various recipients. For example, in the example above, a userinterface may be provided to allow a user to upload personalized postagethat will be affixed to a distribution item 8 along with uploadingcontent that will be delivered to a recipient according to the figuresdescribed above. Furthermore, other systems and devices and accompanyinguser interfaces may be provided for mailers. For example, a mailersending an advertising campaign may be able to sign up to associatecontent with distribution using systems and services provided by thedistribution service provider. User interfaces may be provided to allowthe mailer to associate different content with an information item 10 ora group of information items that will be sent with each distributionitem 8. The mailer may further be able to customize the contentaccording to the types of information that will be provided when therecipient processes the information item(s) 10. In conjunction with thedisclosure above, one skilled in the art will appreciate the systems anddevices and user interfaces that may be provided to allow for managing amailing and associating targeted content with distribution items 8 thatmay be experienced by a recipient 12 via a computing device 14.

As described above, the systems and devices operated by the distributionservice provider may provide the functionality to allow a computingdevice 14 to access content related to a distribution item 8 by usinginformation items 10 on the distribution item 8. For example, thesystems and devices operated by the distribution service provider mayperform image recognition and other image processing and/or dataprocessing to extract data from information items 10 captured by acomputing device 14. The system and devices operated by the distributionservice provider may further provide connectivity to third partyservices that host content or provide customized content. Further, aspreviously described, the systems and devices operated by thedistribution service provider may provide user interfaces for allowingmailers to upload content and associate content with distribution itemsthat will be sent.

Furthermore, the systems and applications described herein may furtherincorporate security measures that protect against various exploits(e.g., bots harvesting content) and to protect user data to ensure thatuser data being transmitted is not compromised. One skilled in the artwill appreciate the various security measures that may be provided.

It should be further appreciated that the manner in which content isdelivered via a computing device 14 may be performed in variety of ways.In some embodiments content is provided through a link that providesaccess to associated content in a web browser. In other embodiments, thecontent may be provided via a native application or integrated videoplayer. In another embodiment, a computing device 14 may not have adisplay and may physically print content, or provide content throughother mediums.

Customized Shipping Options

FIG. 26 shows an example of one aspect of a system for providing contentassociated with a product to a purchaser 12 using an information item10, as described above. In one embodiment, the purchaser 12 may be arecipient of a distribution item 8, as described in association withFIG. 2. The system may provide content associated with the distributionitem 8 to the purchaser 12 of the distribution item 8 by using theinformation item 10. Additional types of possible information item 10 onthe distribution item 8 may include Quick Response (QR) codes orUniversal Product Codes (UPC) codes. A purchaser 12 may be an individualor any other entity described above. In certain embodiments theinformation item 10 is not limited to placement on a distribution item8. For example, the encoded value 10 may be displayed on a physicalproduct located in a store or the encoded value may be found in anadvertisement or catalog.

The purchaser 12 can capture the information item 10 using a computingdevice 14 equipped with a digital camera. The computing device 14 can bea smart phone with an integrated digital camera, a personal computerwith an attached digital camera device, a laptop computer with anintegrated digital camera, a tablet computer, or any other computingdevice 14 capable of capturing and processing images. Once an image ofthe information item 10 has been captured by the computing device 14,the purchaser 12 may decode the information item 10 using the computingdevice 14 capable of transmitting a encoded or decoded value over anetwork 16. The encoded or decoded value may then be provided to aserver 18, such as a web server, to retrieve the content or anindication of content associated with the distribution item 8 andidentified by intelligent barcode 30 or other image as described above.The server 18 may then deliver the content to the computing device 14over the network 16.

In one embodiment, the server 18 may act as a host server or networkservice to host the content of, for example, a merchant, such as aneCommerce merchant or interne merchant. The host server may be operatedby the U.S. Postal Service. The content hosted on the remote server 18may be delivered to the computing device 14. The content may be, forexample, a product catalog containing product information such as price,size, color, or quantity available. Through communication with theremote server 18, the purchaser 12 may purchase one or more productsoffered for sale by the merchant. The purchase information may be routedto the server 72 of the merchant for order fulfillment. The accountingtransaction may occur on the hosting server 18 or on the merchant server72. User payment information may be stored on the hosting server 18 orother merchant server 72 that may allow for using different types ofpayments methods such as, but not limited to, credit cards, debit cards,PayPal, and the like.

In one embodiment, the hosting server 18 may route the purchaser 12 tothe merchant server 72. The eCommerce partner server 72 may then delivercontent to the computing device 14 over the network 16 by either passingthe information through the hosting server 18 or delivering the contentdirectly to the computing device 14 over the network 16. The content maybe, for example, a product catalog containing product information suchas price, size, color, and quantity available. Information may also beprovided in the form of deferred purchase reminders, barcodes, QR codes,product images, and the like as described above. Through communicationwith the merchant server 72, the purchaser 12 may purchase one or moreproducts offered for sale by the merchant.

As part of the purchase of the product, the purchaser 12 may bepresented with an option of selecting a shipping location to which tohave the product shipped. The purchaser 12 may choose to have the ordershipped to his or her residence 96 or place of business (not shown). Thepurchaser 12 may also choose to have the order shipped to another personat his or her residence 96 or place of business. The purchaser 12 mayalso be presented with the option to have the order shipped to analternative pick-up location 78, such as, for example, a U.S. PostOffice. For example, the purchaser 12 may be able to set up deliverysuch that the merchant is aware of the destination mailer officeaddress, but the actual delivery address is known exclusively by themailer. In another embodiment, as is further described below, anonymousdelivery may be provided. In addition, the purchaser 12 may be presentedwith information relating to different shipping pricing information andshipping service commitment information. The purchaser 12 may further beprovided with tracking information and to set up tracking notifications.Information exchanged between the computing device 14 of the purchaserand the host server 18 or the merchant server 72 may be exchangedsecurity using a secured electronic data interchange, e.g., via theInternet.

The hosting server 18 may generate a unique identifier 94 to beassociated with the order for the purchase of the products. The uniqueidentifier 94 may be, for example, a series of or letters or numbers, asymbol, a picture, or a number chosen by the purchaser 12 or acombination of any of these options. The unique identifier 94 may betransmitted from the hosting server 18 to the merchant server 72. Theunique identifier 94 may also be transmitted from the hosting server 18to the computing device 14 to be viewed by the purchaser 12. Thepurchaser 12 may be required to disclose the unique identifier 94 to adelivery person 98 a, 98 b at a later time in order to receive theproduct from the delivery person 98 a, 98 b.

When the merchant has received the order information and the uniqueidentifier 94 from the hosting server 18, the merchant may fulfill theorder at the merchant's facility 74. The ordered product 92 may beprovided to a shipping service 76, such as, for example, the U.S. PostalService, to be delivered to the shipping location chosen by thepurchaser 12. In one embodiment, the merchant may also provide to theshipping service 76 the unique identifier 94. In one embodiment, theunique identifier may be transmitted directly from the hosting server 18to the shipping service 76 without requiring the merchant to relay theunique identifier 94 to the shipping service 76. The shipping service 76may then deliver the product to the shipping location, such as thechosen pick-up location 78 or the purchaser's residence 96.

If the purchaser 12 has chosen a residence 96 or place of business asthe shipping location, the shipping service 76 can deliver the product92 directly to the residence 96 or place of business. In such a case,the shipping service 76 and delivery personnel 98 a would have receivedthe unique identifier 94 from the hosting server 18. In order to providethe product to the purchaser 12 a (or the purchaser's representative)upon delivery, the purchaser 12 a would be required to disclose orotherwise provide proof of the unique identifier 94 to the deliverypersonnel 98 a. When the delivery personnel 98 a is assured that theunique identifier 94 disclosed by the purchaser 12 a matches the uniqueidentifier 94 provided by the hosting server 18, the delivery personnel98 a may transmit the product 92 to the purchaser 12 a.

In one embodiment, the purchaser 12 may choose a pick-up location 78 asthe shipping location. In one embodiment, the pick-up location 78 may bea U.S. Post Office. In this manner the shipping service 76 delivers theproduct 92 to the pick-up location 78 for retrieval by the purchaser 12b. The purchaser may be notified by the hosting server 18 that theproduct 92 has been delivered to the pick-up location 78 and isavailable for retrieval by the purchaser 12 b. The unique identifier 94may be provided by the shipping service 76 to the pick-up location 78 atthe time of delivery. When the purchaser 12 b arrives at the pick-uplocation 78 to retrieve the product 92, the purchaser 12 a is requiredto disclose or otherwise provide proof of the unique identifier 94 todelivery personnel 98 b. When the delivery personnel 98 b is assuredthat the unique identifier 94 disclosed by the purchaser 12 b matchesthe unique identifier 94 provided by the hosting server 18, the deliverypersonnel 98 b may transmit the product 92 to the purchaser 12 a.

According to one embodiment, a potential recipient may sign up for aservice to have items delivered to a locker. As such, the uniqueidentifier 94 may be identified for deliver to a specific locker. Themailer would receive the unique identifier that may be provided to theshipping service 76 to allow the shipping service to know what locker todeliver an item to. The purchaser may then be notified electronicallywhen there is an item in the locker to be retrieved. The purchaser 12may then retrieve the item from the locker. By using a unique identifierin conjunction with the systems just described, the user can anonymouslybe delivered and pick up a product.

FIG. 27 shows a flowchart of an exemplary method for facilitating thepurchase and delivery of a product as shown in FIG. 26. The method 2700may begin at block 2702 when a distribution item 8, product, catalog,advertisement, etc. having a machine-readable encoded value is receivedand/or viewed by a purchaser. The machine-readable encoded value may bean intelligent barcode 30 as described above. In block 2704, the machinereadable encoded value is processed and decoded using a computing device14. The computing device 14 may be, for example, a desktop computer, aportable computer (e.g., laptop, netbook, etc.), a smart-phone, a tabletcomputer, or the like. The processing may include capturing informationabout the encoded value, and decoding or preparing the encoded value sothat it may be used by a network service to determine informationassociated with the distribution item 8 as will be further describedbelow.

After processing and decoding the encoded value in block 2704, in block2706 the processed encoded value is provided to a network service andthe network service may retrieve information associated with the encodedvalue 10 based on the information about the encoded value received fromthe computing device 14. The network service may provide the informationassociated with the encoded value 10 to the computing device 14. Thisinformation may be provided in a variety of forms, such as text viewableon the computing device 14, a link to further content accessible via aweb browser on the computing device 14, media files, purchasinginformation or other information that may be used by the computingdevice 14 to access information associated with the encoded value 10 andassociated product.

In some embodiments, the processed encoded value may be an image of theencoded value prepared for decoding by the network service. In otherembodiments, the processed encoded value may be a decoded or partiallydecoded value which may be used by the network service to determineinformation associated with the distribution item 8, as will bedescribed in further detail below.

In block 2706, the network service may determine and/or retrieveinformation associated with the distribution item 8 based on theinformation about the encoded value received from the computing device14. The network service may provide the information associated with theencoded value and the product to the computing device 14 and may enablethe purchasing of a product in block 2708.

In block 2710, the network service may allow the purchaser of theproduct to choose a shipping location and in block 2712 may generate andprovide to the purchaser a unique identifier associated with the orderof the product. The unique identifier may also be provided to themerchant selling the product and/or the shipping service tasked withdelivering the product. The unique identifier may be a series of numbersor letters, a picture, or a symbol. The merchant may then fulfill theorder and provide the product to the shipping service for delivery inblock 2714.

In block 2714, the shipping service may deliver the product to theshipping location chosen by the purchaser. The shipping location can bea residence or place of business of the purchaser or may be theresidence or place of business of another person to whom the purchaserwould like to send the product. Alternatively, the shipping location canbe a pick-up location, such as a U.S. Post Office or other shippingservice hub.

If the purchaser elects to send the product to a residence or place ofbusiness, the delivery personnel would, in block 2716, receive from thepurchaser (or person to whom the purchaser had the product sent) theunique identifier. In this manner, the product may be shipped usingsemi-discrete shipping in that the delivery personnel would know theshipping location, but the merchant need not know the shipping location,but only the unique identifier to fulfill the order and provide theproduct to the shipping service. The delivery personnel then may receivethe unique identifier and match the unique identifier with the shippinglocation which would be received from the network services, such ashosted by the U.S. Postal Service. The delivery personnel may thenverify that the unique identifier provided by the purchaser matches theunique identifier generated by the network services. The deliverypersonnel may then provide the product to the purchaser in block 2718.

If the purchaser elects to send the product to a pick-up location, thedelivery personnel would, in block 2716, deliver the product to thepick-up location. The purchaser (or the purchaser's authorizedrepresentative) may then be notified of the delivery of the product tothe pick-up location. In this manner, the product may be shipped anddelivered using a discrete shipping method because the deliverypersonnel and the pick-up location personnel would not need to know theaddress of the residence or place of business of the purchaser. Thepurchaser may then go to the pick-up location to retrieve the product.At the pick-up location the personnel at the pick-up location would thenreceive from the purchaser the unique identifier and verify that itmatches the unique identifier generated by the network services. Thepick-up location personnel may then provide the product to the purchaserin block 2718. The method described by FIG. 27 may be repeated for anydistribution item 8 or other product with an encoded value such as anintelligent barcode 30.

As mentioned above, while several aspects of several embodiments havebeen described above with respect to intelligent barcodes, a widevariety of machine-readable encoded values are contemplated by thedevelopment. For example, the encoded values could correspond to othertypes of barcodes and further to include 2D barcodes and othermachine-readable values. Furthermore, the encoded value may simply be astring of numbers which may be decoded and interpreted according to theembodiments described above.

While several aspects of several embodiments have been described abovewith respect to distribution items, an information item 10 along withthe systems and methods described above may be used with a wide varietyof distribution items. Distribution items may include distributionitems, products, periodicals, books, and the like. Furthermore,information items 10 may be affixed to other objects and are not limitedto distribution items. As such, the intelligent barcode and the systemsand methods described above may be used in a variety of contexts notlimited to a mailing system and may be used in conjunction with avariety of products and or items. Interactive content and furtherservices or offerings may be accessed via a computing device for any oneof these items similar to the descriptions provided above.

A detailed block diagram of an example computer environment, accordingto some embodiments, is now described. In particular, FIG. 28illustrates a computing device 14 that may be used for processing aninformation item 10 affixed to a distribution item 8, according to someexample embodiments as describe above. As illustrated in FIG. 28, thecomputing device 14 comprises a processor(s) 1710. The computing device1702 also includes a memory unit 2812, a processor bus (not shown), andan Input/Output controller hub (ICH) (not shown). The processor(s) 2810,the memory unit 2812, and the ICH are coupled to a processor bus (notshown). The processor(s) 2810 may comprise any suitable processorarchitecture. The computing device 14 may comprise one, two, three, ormore processors, any of which may execute a set of instructions inaccordance with embodiments of the development.

The memory unit 2812 may store data and/or instructions, and maycomprise any suitable memory, such as a dynamic random access memory(DRAM). The computing device 14 may also includes an IDE drive(s) (notshown) and/or other suitable storage devices. A graphics controller 2816controls the display of information on a display device 2818, accordingto some embodiments of the development. A camera module 2820 may also beincluded which includes hardware and/or circuitry that allows images tobe captured that may be stored in the memory 2812 and processed usingthe processor(s) 2816. The computing device may further have a nearfield communication (NFC) module (not shown) which may be an RFID tagreader or other NFC hardware that allows communication with other shortrange wireless objects, affixed, for example, to a distribution item. Inaddition, the computing device 14 may include a global positioningsystem (GPS) module that may provide data with respect to the geographiclocation of the computing device 14.

The input/output controller hub (ICH) (not shown) provides an interfaceto I/O devices or peripheral components for the computer system 14. TheICH may comprise any suitable interface controller to provide for anysuitable communication link to the processor(s), the memory unit 2812,and/or to any suitable device or component in communication with theICH. In one embodiment of the development, the ICH provides suitablearbitration and buffering for each interface.

As also shown in FIG. 28, a server 18 is illustrated that may be used tocarry out the functions as described with reference to the figuresabove. The server 18 may include a processor(s) 2824. The server 18 alsoincludes a memory unit 2826 and a processor bus (not shown). Theprocessor(s) 2824 and the memory unit 2826 are coupled to a processorbus (not shown). The processor(s) 2826 may comprise any suitableprocessor architecture. The server 18 may comprise one, two, three, ormore processors, any of which may execute a set of instructions inaccordance with embodiments of the development.

The memory unit 2826 may store data and/or instructions, and maycomprise any suitable memory, such as a dynamic random access memory(DRAM). The server 18 may also includes an IDE drive(s) (not shown)and/or other suitable storage devices. The server may further be able tocommunicate with a database 2830 that may be integrated along with thehardware of the server or may be in a different location. The server 18may further comprise network interface modules and hardware forcommunicating over a network. The server 18 may further comprise a webservice module 2828. In some embodiments the web service module 2828 maycomprise instructions stored in memory 2826 and executed using theprocessor 2824.

In some embodiments, the computing device 14 includes a machine readablemedium that stores a set of instructions (e.g., software) embodying anyone, or all, of the methodologies described herein. Furthermore,software may reside, completely or at least partially, within the memoryunit 2812 and/or within the processor(s) 2810.

Those of skill will further recognize that the various illustrativelogical blocks, modules, circuits, and algorithm steps described inconnection with the embodiments disclosed herein may be implemented aselectronic hardware, software stored on a computer readable medium andexecutable by a processor, or combinations of both. To clearlyillustrate this interchangeability of hardware and software, variousillustrative components, blocks, modules, circuits, and steps have beendescribed above generally in terms of their functionality. Whether suchfunctionality is implemented as hardware or software depends upon theparticular application and design constraints imposed on the overallsystem. Skilled artisans may implement the described functionality invarying ways for each particular application, but such embodimentdecisions should not be interpreted as causing a departure from thescope of the present invention.

The various illustrative logical blocks, modules, and circuits describedin connection with the embodiments disclosed herein may be implementedor performed with a general purpose processor, a digital signalprocessor (DSP), an application specific integrated circuit (ASIC), afield programmable gate array (FPGA) or other programmable logic device,discrete gate or transistor logic, discrete hardware components, or anycombination thereof designed to perform the functions described herein.A general purpose processor may be a microprocessor, but in thealternative, the processor may be any conventional processor,controller, microcontroller, or state machine. A processor may also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration.

If implemented in software, the functions may be stored on ortransmitted over as one or more instructions or code on acomputer-readable medium. The steps of a method or algorithm disclosedherein may be implemented in a processor-executable software modulewhich may reside on a computer-readable medium. Computer-readable mediaincludes both computer storage media and communication media includingany medium that can be enabled to transfer a computer program from oneplace to another. A storage media may be any available media that may beaccessed by a computer. By way of example, and not limitation, suchcomputer-readable media may include RAM, ROM, EEPROM, CD-ROM or otheroptical disk storage, magnetic disk storage or other magnetic storagedevices, or any other medium that may be used to store desired programcode in the form of instructions or data structures and that may beaccessed by a computer. Also, any connection can be properly termed acomputer-readable medium. Disk and disc, as used herein, includescompact disc (CD), laser disc, optical disc, digital versatile disc(DVD), floppy disk, and blu-ray disc where disks usually reproduce datamagnetically, while discs reproduce data optically with lasers.Combinations of the above should also be included within the scope ofcomputer-readable media. Additionally, the operations of a method oralgorithm may reside as one or any combination or set of codes andinstructions on a machine readable medium and computer-readable medium,which may be incorporated into a computer program product.

It should be understood that any reference to an element herein using adesignation such as “first,” “second,” and so forth does not generallylimit the quantity or order of those elements. Rather, thesedesignations may be used herein as a convenient method of distinguishingbetween two or more elements or instances of an element. Thus, areference to first and second elements does not mean that only twoelements may be employed there or that the first element must precedethe second element in some manner. Also, unless stated otherwise a setof elements may include one or more elements.

A person/one having ordinary skill in the art would understand thatinformation and signals may be represented using any of a variety ofdifferent technologies and techniques. For example, data, instructions,commands, information, signals, bits, symbols, and chips that may bereferenced throughout the above description may be represented byvoltages, currents, electromagnetic waves, magnetic fields or particles,optical fields or particles, or any combination thereof.

It is understood that any specific order or hierarchy of steps in anydisclosed process is an example of a sample approach. Based upon designpreferences, it is understood that the specific order or hierarchy ofsteps in the processes may be rearranged while remaining within thescope of the present disclosure. The accompanying method claims presentelements of the various steps in a sample order, and are not meant to belimited to the specific order or hierarchy presented.

Certain features that are described in this specification in the contextof separate embodiments also can be implemented in combination in asingle embodiment. Conversely, various features that are described inthe context of a single embodiment also can be implemented in multipleembodiments separately or in any suitable sub-combination. Moreover,although features may be described above as acting in certaincombinations and even initially claimed as such, one or more featuresfrom a claimed combination can in some cases be excised from thecombination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

Similarly, while operations are depicted in the drawings in a particularorder, this should not be understood as requiring that such operationsbe performed in the particular order shown or in sequential order, orthat all illustrated operations be performed, to achieve desirableresults. In certain circumstances, multitasking and parallel processingmay be advantageous. Moreover, the separation of various systemcomponents in the embodiments described above should not be understoodas requiring such separation in all embodiments, and it should beunderstood that the described program components and systems cangenerally be integrated together in a single software product orpackaged into multiple software products. Additionally, otherembodiments are within the scope of the following claims. In some cases,the actions recited in the claims can be performed in a different orderand still achieve desirable results.

1. A computerized method comprising: identifying an image of aninformation item on a distribution item; processing, in a processor theimage, to generate a data item determined by the information item;decoding the data item to determine a set of attributes of thedistribution item; retrieving content associated with the distributionitem using at least one of the attributes in the set of attributes; anddelivering content associated with the distribution item.
 2. Thecomputerized method of claim 1, wherein the information item is providedby a distribution entity to route and track the distribution item forphysical delivery.
 3. The computerized method of claim 1, wherein theinformation item comprises a barcode, and wherein the data itemcomprises a character string determined by the barcode.
 4. Thecomputerized method of claim 1, wherein the information item comprisesat least one of an image, a stamp, and a combination of an image and anencoded value.
 5. The computerized method of claim 1, wherein at leastone attribute in the set of attributes comprises an identifiercorresponding to a mailer and wherein the content comprises at least oneof a product or service offering associated with the mailer.
 6. Thecomputerized method of claim 1, wherein the content comprisesinformation associated with a Special Intelligent Mail Service™
 7. Thecomputerized method of claim 1, wherein the set of attributes comprisesat least one of a barcode identifier, a service type identifier, amailer identifier, a distribution item identifier, and a routing code.8. The computerized method of claim 7, further comprising validating theset of attributes and providing an error message to the computing deviceif the set of attributes is invalid.
 9. The computerized method of claim3, wherein decoding the character string to determine a set ofattributes of the distribution item and retrieving content associatedwith the distribution item using at least one of the attributes in theset of attributes comprises: transmitting the character string over anetwork to a server configured to decode the character string todetermine a set of attributes of the distribution item and retrievecontent associated with the distribution item using at least one of theattributes in the set of attributes; and receiving a response from theserver comprising content associated with the distribution item.
 10. Thecomputerized method of claim 9, wherein the response comprises a link tothe content associated with the distribution item, wherein displayingthe content associated with the distribution item comprises viewing thelink in a web browser.
 11. The computerized method of claim 3, whereinretrieving content associated with the distribution item using at leastone of the attributes in the set of attributes comprises: transmittingthe identified image of the encoded value over a network to a serverconfigured to decode the character string to determine a set ofattributes of the distribution item and retrieve content associated withthe distribution item using at least one of the attributes in the set ofattributes; and receiving a response from the server comprising contentassociated with the distribution item
 12. The computerized method ofclaim 11, wherein the response comprises a link to the contentassociated with the distribution item, wherein the enabling thecomputing device to view the content associated with the distributionitem comprises viewing the link in a web browser.
 13. The computerizedmethod of claim 3, wherein the barcode comprises at least one of anIntelligent Mail™ Barcode and a height modulated barcode including fourstates.
 14. The computerized method of claim 3, wherein the barcodecomprises a number of vertical bars, and wherein each of the number ofvertical is one of an ascender bar, a descender bar, a full bar, or atracker bar, and wherein a character in the character string comprises aletter corresponding to one of the ascender bar, descender bar, fullbar, or tracker bar.
 15. The computerized method of claim 1, furthercomprising providing an overlay frame on a display device of thecomputing device for use in identifying the image of the encoded value.16. The computerized method of claim 1, wherein identifying an image ofan encoded value on a distribution item using a camera on a computingdevice comprises identifying the image from a live video stream from thecamera of the computing device.
 17. The computerized method of claim 1,wherein identifying the image further comprises using a successiveagreement algorithm.
 18. The computerized method of claim 1, whereinprocessing the image to generate a character string determined by anencoded value of the information item comprises: scanning horizontallines in the image to identify an area of the image with a determinednumber of vertical lines; locating a center line of the image;determining the heights and positions of each vertical line; associatingeach vertical line with a character determined by the height andposition of each vertical line; and combining the character for eachvertical line to form the character string.
 19. The computerized methodof claim 1 further comprising displaying the identified image on adisplay device of the computing device.
 20. The computerized method ofclaim 1, wherein the information item comprises an image of a productbeing advertised by the distribution item, and wherein the contentcomprises interactive product information about the product.
 21. Thecomputerized method of claim 1, wherein the information item comprisesan Intelligent Mail Barcode™, and wherein the content comprisesinteractive product information about a product being advertised in thedistribution item.
 22. A computing device comprising: an image capturedevice; a processor configured to receive image data from the imagecapture device, wherein the processor is configured to identify an imageof an information item on a distribution item using the image data andgenerate a data item determined by the information item; a decodercomponent configured to at least partially decode the data item todetermine a set of attributes of the distribution item; a networkcomponent configured to transmit at least one of the attributes in theset of attributes and to receive a response indicating contentassociated with the distribution item; and a display device configuredto display the image of the encoded value and to display the contentassociated with the distribution item.
 23. The computing device of claim22, wherein the information item is provided by a distribution entity toroute and track the distribution item for physical delivery.
 24. Thecomputing device of claim 22, wherein at least one attribute in the setof attributes comprises an identifier corresponding to a mailer andwherein the content comprises a product or service offering associatedwith the mailer.
 25. The computing device of claim 22, wherein the setof attributes comprises at least one of a barcode identifier, a servicetype identifier, a mailer identifier, a distribution item identifier,and a routing code.
 26. The computing device of claim 22, wherein theresponse comprises a link to the content associated with thedistribution item, wherein the enabling the computing device to view thecontent associated with the distribution item comprises viewing the linkin a web browser.
 27. The computing device of claim 22, wherein theinformation comprises a barcode.
 28. The computing device of claim 27,wherein the barcode comprises a number of vertical bars, and whereineach of the number of vertical is one of an ascender bar, a descenderbar, a full bar, or a tracker bar, and wherein a character in thecharacter string comprises a letter corresponding to one of the ascenderbar, descender bar, full bar, or tracker bar.
 29. The computing deviceof claim 22, wherein the display device is configured to display anoverlay frame for use in identifying the image of the encoded value. 30.The computing device of claim 22, wherein the information item comprisesan image of a product being advertised by the distribution item, andwherein the content comprises interactive product information about theproduct.
 31. The computing device of claim 22, wherein the informationitem comprises an Intelligent Mail Barcode™, and wherein the contentcomprises interactive product information about a product beingadvertised in the distribution item.
 32. A system comprising: acomputing device comprising: an image capture device; a processorconfigured to receive image data from the image capture device, whereinthe processor is configured to identify an image of an encoded value ona distribution item using the image data and generate a character stringdetermined by the encoded value; a network component configured totransmit the character string; and a display device; and a server,remote from the computing device configured to receive the characterstring, the server comprising: a decoding component configured to decodethe character string to determine a set of attributes of thedistribution item; a processing component configured to retrieve contentassociated with the distribution item using at least one attribute inthe set of attributes of the distribution item; and wherein the serveris configured to send a message to the computing device indicatingcontent associated with the distribution item, wherein the displaydevice is configured to display the image of the decoded value and todisplay the content associated with the distribution item in response tothe message from the server.
 33. The system of claim 32, wherein theinformation item is provided by a distribution entity to route and trackthe distribution item for physical delivery.
 34. A computerized methodcomprising: retrieving an image of an information item from adistribution item using a computing device; processing in a processorthe image so as to decode the information item to determine a set ofattributes of the distribution item; retrieving content associated withthe distribution item using at least one of the attributes in the set ofattributes; and enabling the computing device to deliver the contentassociated with the distribution item.
 35. The computerized method ofclaim 34, wherein the information item comprises at least one of abarcode, an image, a stamp, or a combination of alphanumeric informationand an image.
 36. The computerized method of claim 35, wherein thebarcode comprises at least one of an Intelligent Mail™ Barcode, a QuickResponse Barcode, and a UPC Barcode.
 37. The computerized method ofclaim 36, wherein the content associated with the distribution item isproduct information.
 38. The computerized method of claim 34, furthercomprising enabling a purchase of a product on the computing device by apurchaser.
 39. The computerized method of claim 38, wherein enabling thepurchase of a product further comprises: generating a unique identifierfor the purchase; enabling the purchaser to choose a shipping location;delivering the product to the shipping location; and receiving theunique identifier from the purchaser at the shipping location as arequirement for giving the product to the purchaser.
 40. Thecomputerized method of claim 39, wherein the unique identifier comprisesat least one of a symbol, a randomly generated number, a keyword, and anumber chosen by the purchaser.
 41. The computerized method of claim 39,wherein the shipping location is at least one of a U.S. Post Office andthe purchaser's home or business.
 42. The computerized method of claim34, wherein the information item is provided by a distribution entity toroute and track the distribution item for physical delivery.
 43. Acomputing device for processing a distribution item, the devicecomprising: means for identifying an image of an information item on thedistribution item; means for processing the image to generate a dataitem determined by the information item; means for decoding the dataitem to determine a set of attributes of the distribution item; meansfor retrieving content associated with the distribution item using atleast one of the attributes in the set of attributes; and meansdelivering content associated with the distribution item.
 44. Thecomputing device of claim 43, wherein the information item is providedby a distribution entity to route and track the distribution item forphysical delivery.